Max level shown:
1 [ Aug 27 19:02:05 Enabled. ]
2 [ Aug 27 19:02:05 Rereading configuration. ]
3 [ Aug 27 19:02:09 Rereading configuration. ]
4 [ Aug 27 19:02:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Aug 27 19:02:28 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-08-27T19:02:28.761ZDEBGnexus: registered DTrace probes
82024-08-27T19:02:28.762ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:86
92024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-08-27T19:02:28.770ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-08-27T19:02:28.771ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-08-27T19:02:28.771ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-08-27T19:02:28.792ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:217
612024-08-27T19:02:28.795ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-08-27T19:02:28.799ZINFOnexus (ServerContext): Accessing DB url from DNS file = nexus/src/context.rs:246
632024-08-27T19:02:28.817ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("19bd4462-2353-4408-860c-54bff4d4af2c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("68c29e6d-6134-4678-be81-fd53901e9105.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("a0cd76dd-890f-40d6-b9c9-466b1152d492.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("afb193bd-2840-4e76-a967-0dee9f03c40c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("dae07c98-fe1f-4226-b25a-884690e85195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dae07c98-fe1f-4226-b25a-884690e85195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::3))) }], valid_until: Instant { tv_sec: 893, tv_nsec: 471671334 } })
642024-08-27T19:02:28.819ZINFOnexus (ServerContext): DB addresses: [fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221 file = nexus/src/context.rs:276
652024-08-27T19:02:28.823ZINFOnexus (db::Pool): database connection pool database_url = postgresql://root@[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221/omicron?sslmode=disable file = nexus/db-queries/src/db/pool.rs:69
662024-08-27T19:02:29.041ZINFOnexus: Database schema version is up to date desired_version = 92.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 92.0.0
672024-08-27T19:02:29.044ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
682024-08-27T19:02:29.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 893, tv_nsec: 698860601 } })
692024-08-27T19:02:29.045ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
702024-08-27T19:02:29.093ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
712024-08-27T19:02:29.093ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
722024-08-27T19:02:29.100ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97cd5dc9-5cd5-49cb-9772-27a9aff4b3bf", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:29 GMT"} })
732024-08-27T19:02:29.100ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
742024-08-27T19:02:29.101ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
752024-08-27T19:02:29.132ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 893, tv_nsec: 787290566 } })
762024-08-27T19:02:29.133ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
772024-08-27T19:02:29.166ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
782024-08-27T19:02:29.166ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
792024-08-27T19:02:29.167ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8872266e-ab57-49b8-9d41-fee7dfc156d4", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:29 GMT"} })
802024-08-27T19:02:29.167ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
812024-08-27T19:02:29.167ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
822024-08-27T19:02:29.249ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-08-27T19:02:29.268ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-08-27T19:02:29.269ZDEBGnexus (DataLoader): attempting to create built-in users
852024-08-27T19:02:29.271ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-08-27T19:02:29.272ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
882024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
892024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
902024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
912024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
922024-08-27T19:02:29.278ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
932024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
942024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
952024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
962024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
972024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
982024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
992024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1002024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1012024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
1022024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1032024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1042024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1052024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1062024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1072024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1082024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1092024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1102024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1112024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1122024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1132024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1142024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1152024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1162024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1172024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1182024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1192024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1202024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1212024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1222024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1232024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1242024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1252024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id}
1262024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1272024-08-27T19:02:29.279ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12221
1282024-08-27T19:02:29.279ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1292024-08-27T19:02:29.280ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1302024-08-27T19:02:29.280ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1312024-08-27T19:02:29.290ZWARNnexus: Cannot look up rack: Object (of type ById(c74aab71-8e38-4613-a469-5ba1cc230991)) not found: rack file = nexus/src/app/rack.rs:771
1322024-08-27T19:02:29.429ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1332024-08-27T19:02:29.429ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-08-27T19:02:29.430ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-08-27T19:02:29.431ZDEBGnexus (DataLoader): attempting to create built-in roles
1362024-08-27T19:02:29.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-08-27T19:02:29.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-08-27T19:02:29.492ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1392024-08-27T19:02:29.492ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-08-27T19:02:29.493ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-08-27T19:02:29.493ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1422024-08-27T19:02:29.493ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432024-08-27T19:02:29.493ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442024-08-27T19:02:29.720ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1452024-08-27T19:02:29.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-08-27T19:02:29.721ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-08-27T19:02:29.721ZDEBGnexus (DataLoader): attempting to create built-in silos
1482024-08-27T19:02:29.722ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-08-27T19:02:29.722ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-08-27T19:02:29.906ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1512024-08-27T19:02:29.908ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522024-08-27T19:02:29.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532024-08-27T19:02:29.911ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-08-27T19:02:29.912ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-08-27T19:02:29.912ZDEBGnexus (DataLoader): attempting to create built-in projects
1562024-08-27T19:02:29.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-08-27T19:02:29.913ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-08-27T19:02:29.919ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-08-27T19:02:29.920ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-08-27T19:02:29.962ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-08-27T19:02:29.962ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-08-27T19:02:29.992ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-08-27T19:02:29.996ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1642024-08-27T19:02:29.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-08-27T19:02:29.996ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-08-27T19:02:29.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-08-27T19:02:29.997ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682024-08-27T19:02:29.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-08-27T19:02:29.999ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1702024-08-27T19:02:30.000ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-08-27T19:02:30.000ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-08-27T19:02:30.035ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1732024-08-27T19:02:30.036ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-08-27T19:02:30.036ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-08-27T19:02:30.036ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1762024-08-27T19:02:30.036ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-08-27T19:02:30.036ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782024-08-27T19:02:30.056ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-08-27T19:02:30.056ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-08-27T19:02:30.077ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-08-27T19:02:30.077ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-08-27T19:02:30.078ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-08-27T19:02:30.078ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-08-27T19:02:30.079ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-08-27T19:02:30.079ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-08-27T19:02:30.080ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-08-27T19:02:30.082ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1882024-08-27T19:02:30.082ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-08-27T19:02:30.082ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-08-27T19:02:30.083ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-08-27T19:02:30.083ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-08-27T19:02:30.084ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-08-27T19:02:30.084ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-08-27T19:02:30.084ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-08-27T19:02:30.087ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1962024-08-27T19:02:30.087ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-08-27T19:02:30.087ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-08-27T19:02:30.182ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-08-27T19:02:30.182ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-08-27T19:02:30.184ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-08-27T19:02:30.184ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-08-27T19:02:30.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-08-27T19:02:30.185ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-08-27T19:02:30.186ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-08-27T19:02:30.186ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-08-27T19:02:30.187ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-08-27T19:02:30.190ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2082024-08-27T19:02:30.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-08-27T19:02:30.190ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-08-27T19:02:30.221ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "Unknown diesel error creating VpcRouter called \\"system\\": Record not found" } file = nexus/src/populate.rs:126
2112024-08-27T19:02:30.221ZERROnexus: populate failed file = nexus/src/app/mod.rs:516
2122024-08-27T19:02:30.221ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
2132024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
2142024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
2152024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
2162024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
2172024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
2182024-08-27T19:02:30.230ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
2192024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
2202024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
2212024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
2222024-08-27T19:02:30.230ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
2232024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
2242024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
2252024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
2262024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2272024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
2282024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2292024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2302024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
2312024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2322024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2332024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
2342024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.329737ms iteration = 1 status = {"error":"no config nor servers"}
2352024-08-27T19:02:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.362048ms iteration = 1 status = {"error":"no blueprint"}
2362024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
2372024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
2382024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
2392024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
2402024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
2412024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
2422024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
2432024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
2442024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
2452024-08-27T19:02:30.232ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
2462024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
2472024-08-27T19:02:30.232ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
2482024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2492024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
2502024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
2512024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2522024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
2532024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
2542024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
2552024-08-27T19:02:30.232ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:71 reason = no blueprint
2562024-08-27T19:02:30.232ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
2572024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2582024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
2592024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
2602024-08-27T19:02:30.232ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
2612024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
2622024-08-27T19:02:30.232ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
2632024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2642024-08-27T19:02:30.232ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
2652024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
2662024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.539972ms iteration = 1 status = {"error":"no config nor servers"}
2672024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
2682024-08-27T19:02:30.232ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
2692024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2702024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2712024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
2722024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2732024-08-27T19:02:30.232ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:52:30.232613503 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
2742024-08-27T19:02:30.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 3.521372ms iteration = 1 status = {"error":"no blueprint"}
2752024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
2762024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
2772024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2782024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2792024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2802024-08-27T19:02:30.234ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2812024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2822024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2832024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
2842024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2852024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2862024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2872024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2882024-08-27T19:02:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2892024-08-27T19:02:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2902024-08-27T19:02:30.236ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 891269038 } })
2912024-08-27T19:02:30.236ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 891358140 } })
2922024-08-27T19:02:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2932024-08-27T19:02:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
2942024-08-27T19:02:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2952024-08-27T19:02:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2962024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2972024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2982024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2992024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3002024-08-27T19:02:30.240ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
3012024-08-27T19:02:30.240ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
3022024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 11.70675ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
3032024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
3042024-08-27T19:02:30.240ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3052024-08-27T19:02:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.37\u{b5}s iteration = 2 status = {"error":"no config"}
3062024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
3072024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
3082024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3092024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3102024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3112024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3122024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3132024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
3142024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3152024-08-27T19:02:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3162024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3172024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3182024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3192024-08-27T19:02:30.243ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
3202024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 15.012097ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
3212024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
3222024-08-27T19:02:30.243ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3232024-08-27T19:02:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.05\u{b5}s iteration = 2 status = {"error":"no config"}
3242024-08-27T19:02:30.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.774054ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3252024-08-27T19:02:30.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3262024-08-27T19:02:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3272024-08-27T19:02:30.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-08-27T19:02:30.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3292024-08-27T19:02:30.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3302024-08-27T19:02:30.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3312024-08-27T19:02:30.287ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 57.652446ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
3322024-08-27T19:02:30.327ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3332024-08-27T19:02:30.330ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
3342024-08-27T19:02:30.330ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3352024-08-27T19:02:30.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3362024-08-27T19:02:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3372024-08-27T19:02:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3382024-08-27T19:02:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3392024-08-27T19:02:30.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3402024-08-27T19:02:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3412024-08-27T19:02:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-08-27T19:02:30.355ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
3432024-08-27T19:02:30.355ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.161805ms iteration = 1 status = {"error":"rack not yet initialized: c74aab71-8e38-4613-a469-5ba1cc230991"}
3442024-08-27T19:02:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3452024-08-27T19:02:30.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3462024-08-27T19:02:30.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3472024-08-27T19:02:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3482024-08-27T19:02:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3492024-08-27T19:02:30.357ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 128.197176ms iteration = 1 status = {}
3502024-08-27T19:02:30.357ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 895, tv_nsec: 11837129 } })
3512024-08-27T19:02:30.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3522024-08-27T19:02:30.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3532024-08-27T19:02:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3542024-08-27T19:02:30.358ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
3552024-08-27T19:02:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3562024-08-27T19:02:30.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3572024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3582024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3592024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3602024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3612024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3622024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3632024-08-27T19:02:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3642024-08-27T19:02:30.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3652024-08-27T19:02:30.360ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
3662024-08-27T19:02:30.360ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.993384ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
3672024-08-27T19:02:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3682024-08-27T19:02:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3692024-08-27T19:02:30.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3702024-08-27T19:02:30.361ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3712024-08-27T19:02:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3722024-08-27T19:02:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3732024-08-27T19:02:30.362ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
3742024-08-27T19:02:30.362ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.558306ms iteration = 1 status = {"error":"inventory collection is None"}
3752024-08-27T19:02:30.379ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3762024-08-27T19:02:30.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3772024-08-27T19:02:30.381ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3782024-08-27T19:02:30.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3792024-08-27T19:02:30.384ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 154.465872ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
3802024-08-27T19:02:30.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3812024-08-27T19:02:30.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3822024-08-27T19:02:30.390ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
3832024-08-27T19:02:30.390ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 159.906444ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
3842024-08-27T19:02:30.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3852024-08-27T19:02:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3862024-08-27T19:02:30.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3872024-08-27T19:02:30.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3882024-08-27T19:02:30.395ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3892024-08-27T19:02:30.395ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "da20d00d-92d5-4497-9590-4a3872d4e90a", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
3902024-08-27T19:02:30.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3912024-08-27T19:02:30.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3922024-08-27T19:02:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3932024-08-27T19:02:30.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3942024-08-27T19:02:30.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3952024-08-27T19:02:30.420ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
3962024-08-27T19:02:30.421ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 895, tv_nsec: 76448557 } })
3972024-08-27T19:02:30.422ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 895, tv_nsec: 77454698 } })
3982024-08-27T19:02:30.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
3992024-08-27T19:02:30.430ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
4002024-08-27T19:02:30.430ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4012024-08-27T19:02:30.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4022024-08-27T19:02:30.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4032024-08-27T19:02:30.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4042024-08-27T19:02:30.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4052024-08-27T19:02:30.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4062024-08-27T19:02:30.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4072024-08-27T19:02:30.444ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.938418ms iteration = 1 status = {}
4082024-08-27T19:02:30.445ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
4092024-08-27T19:02:30.445ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
4102024-08-27T19:02:30.445ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 216.919437ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
4112024-08-27T19:02:30.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 216.714103ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4122024-08-27T19:02:30.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4132024-08-27T19:02:30.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4142024-08-27T19:02:30.456ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:52:30.232613503 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4152024-08-27T19:02:30.456ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 227.3415ms iteration = 1 status = {"expiration":"2024-08-27T18:52:30.232613503Z","pruned":[]}
4162024-08-27T19:02:30.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4172024-08-27T19:02:30.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4182024-08-27T19:02:30.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4192024-08-27T19:02:30.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4202024-08-27T19:02:30.496ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
4212024-08-27T19:02:30.496ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
4222024-08-27T19:02:30.496ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
4232024-08-27T19:02:30.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
4242024-08-27T19:02:30.497ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4252024-08-27T19:02:30.498ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "efb8fb81-9d9f-4b80-8a7a-26728310880a", "content-length": "476", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4262024-08-27T19:02:30.498ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1bc735c-4c7c-45fd-b297-741e9d6d4a69", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4272024-08-27T19:02:30.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4282024-08-27T19:02:30.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4292024-08-27T19:02:30.500ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
4302024-08-27T19:02:30.500ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 271.814378ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
4312024-08-27T19:02:30.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4322024-08-27T19:02:30.503ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
4332024-08-27T19:02:30.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4342024-08-27T19:02:30.504ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f64887df-6a02-4854-b8a2-c4aae8d5b4fd", "content-length": "734", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4352024-08-27T19:02:30.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4362024-08-27T19:02:30.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4372024-08-27T19:02:30.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4382024-08-27T19:02:30.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4392024-08-27T19:02:30.507ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
4402024-08-27T19:02:30.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4412024-08-27T19:02:30.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4422024-08-27T19:02:30.516ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "efbc7257-7c5c-417a-a6a1-33287bb537a9", "content-length": "86", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4432024-08-27T19:02:30.516ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
4442024-08-27T19:02:30.517ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbec47ec-7c26-4d3e-85da-b3027fa32e6d", "content-length": "86", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4452024-08-27T19:02:30.517ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
4462024-08-27T19:02:30.518ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18605b4d-0129-411d-b2bc-514050cefe87", "content-length": "80", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4472024-08-27T19:02:30.518ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
4482024-08-27T19:02:30.519ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c18a8a56-3703-4386-8619-9cc84077f776", "content-length": "80", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4492024-08-27T19:02:30.519ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
4502024-08-27T19:02:30.519ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b63b788-9759-41a4-953c-521ebad319de", "content-length": "88", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4512024-08-27T19:02:30.519ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
4522024-08-27T19:02:30.525ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c2f243b3-f06a-457d-9c9c-a4150b442c55", "content-length": "88", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4532024-08-27T19:02:30.525ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
4542024-08-27T19:02:30.529ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1196f4fb-4f96-4325-acef-f8a007b7ae28", "content-length": "702", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4552024-08-27T19:02:30.529ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4562024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a67851e-0a59-405e-9f8c-4d4f37f2e9e4", "content-length": "727", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4572024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4582024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24335109-cffc-4163-a492-ab0191df90ec", "content-length": "729", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4592024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
4602024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b6bc736-f11b-4584-a128-26e444638f03", "content-length": "728", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4612024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
4622024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27d43a2b-d09b-4660-83c9-7f3ecfaba503", "content-length": "722", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4632024-08-27T19:02:30.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
4642024-08-27T19:02:30.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e079739c-820c-41e0-998d-776982952bc0", "content-length": "84", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4652024-08-27T19:02:30.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
4662024-08-27T19:02:30.532ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4672024-08-27T19:02:30.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5fad53b1-9551-4c7a-9d60-24c7761c530e", "content-length": "84", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4682024-08-27T19:02:30.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
4692024-08-27T19:02:30.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "346c5d38-a8b6-483c-bfc5-1ae4ac9b10eb", "content-length": "82", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4702024-08-27T19:02:30.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
4712024-08-27T19:02:30.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f33ccc8-97f3-43a8-9137-a6ef6dacb84b", "content-length": "82", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4722024-08-27T19:02:30.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
4732024-08-27T19:02:30.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ccfabb3f-3b4c-4f1b-9b4b-9bbcd2b31d33", "content-length": "91", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4742024-08-27T19:02:30.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
4752024-08-27T19:02:30.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19dcfede-b9d9-4325-9cbc-893301a62a35", "content-length": "91", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4762024-08-27T19:02:30.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
4772024-08-27T19:02:30.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fabe1d7b-3cae-447a-8bf0-9923436e74ac", "content-length": "702", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4782024-08-27T19:02:30.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4792024-08-27T19:02:30.536ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4cce55b-7d6a-471d-8ed5-501e9d4f4722", "content-length": "1", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4802024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "230870ba-8958-420d-8bed-f27e32740f3f", "content-length": "727", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4812024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4822024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24346273-14a3-42de-ab0d-7a27c4413f51", "content-length": "729", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4832024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4842024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae82e1d5-63ed-41cc-b316-36a6d7b3fdf0", "content-length": "728", "date": "Tue, 27 Aug 2024 19:02:30 GMT"} })
4852024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4862024-08-27T19:02:30.536ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4872024-08-27T19:02:30.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4882024-08-27T19:02:30.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4892024-08-27T19:02:30.546ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
4902024-08-27T19:02:30.546ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 317.000099ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
4912024-08-27T19:02:30.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922024-08-27T19:02:30.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 325.052114ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
4932024-08-27T19:02:30.554ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942024-08-27T19:02:30.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4952024-08-27T19:02:30.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4962024-08-27T19:02:30.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4972024-08-27T19:02:30.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
4982024-08-27T19:02:30.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4992024-08-27T19:02:30.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5002024-08-27T19:02:30.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5012024-08-27T19:02:30.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5022024-08-27T19:02:30.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5032024-08-27T19:02:30.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5042024-08-27T19:02:30.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-08-27T19:02:30.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5062024-08-27T19:02:30.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5072024-08-27T19:02:30.563ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5082024-08-27T19:02:30.563ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5092024-08-27T19:02:30.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 334.927236ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
5102024-08-27T19:02:30.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5112024-08-27T19:02:30.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5122024-08-27T19:02:30.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5132024-08-27T19:02:30.576ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5142024-08-27T19:02:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5152024-08-27T19:02:30.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5162024-08-27T19:02:30.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5172024-08-27T19:02:30.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5182024-08-27T19:02:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5192024-08-27T19:02:30.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5202024-08-27T19:02:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5212024-08-27T19:02:30.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5222024-08-27T19:02:30.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5232024-08-27T19:02:30.606ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.627017ms iteration = 1 status = null
5242024-08-27T19:02:30.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5252024-08-27T19:02:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5262024-08-27T19:02:30.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5272024-08-27T19:02:30.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5282024-08-27T19:02:30.612ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
5292024-08-27T19:02:30.612ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5302024-08-27T19:02:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5312024-08-27T19:02:30.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5322024-08-27T19:02:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5332024-08-27T19:02:30.613ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5342024-08-27T19:02:30.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5352024-08-27T19:02:30.615ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5362024-08-27T19:02:30.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5372024-08-27T19:02:30.622ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5382024-08-27T19:02:30.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 393.178525ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5392024-08-27T19:02:30.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 409.192311ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5402024-08-27T19:02:30.642ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412024-08-27T19:02:30.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5422024-08-27T19:02:30.644ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5432024-08-27T19:02:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5442024-08-27T19:02:30.645ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 414.698544ms iteration = 1 status = {}
5452024-08-27T19:02:30.645ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5462024-08-27T19:02:30.645ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
5472024-08-27T19:02:30.645ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
5482024-08-27T19:02:30.651ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
5492024-08-27T19:02:30.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 421.499693ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5502024-08-27T19:02:30.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5512024-08-27T19:02:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5522024-08-27T19:02:30.709ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
5532024-08-27T19:02:30.709ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5542024-08-27T19:02:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5552024-08-27T19:02:30.710ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562024-08-27T19:02:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5572024-08-27T19:02:30.714ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5582024-08-27T19:02:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5592024-08-27T19:02:30.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5602024-08-27T19:02:30.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5612024-08-27T19:02:30.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-08-27T19:02:30.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5632024-08-27T19:02:30.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5642024-08-27T19:02:30.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5652024-08-27T19:02:30.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-08-27T19:02:30.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5672024-08-27T19:02:30.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5682024-08-27T19:02:30.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5692024-08-27T19:02:30.789ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 560.067701ms iteration = 1 status = {}
5702024-08-27T19:02:30.862ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
5712024-08-27T19:02:30.862ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
5722024-08-27T19:02:30.862ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
5732024-08-27T19:02:30.862ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 629.647011ms
5742024-08-27T19:02:30.862ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 631.828866ms iteration = 1 status = {}
5752024-08-27T19:02:30.981ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5762024-08-27T19:02:30.981ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 752.470587ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5772024-08-27T19:02:30.982ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5782024-08-27T19:02:30.982ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
5792024-08-27T19:02:30.982ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 752.371796ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
5802024-08-27T19:02:31.068ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 14574b00-bf49-4865-8491-1c34878db3b0 file = nexus/db-queries/src/db/datastore/inventory.rs:893
5812024-08-27T19:02:31.069ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 14574b00-bf49-4865-8491-1c34878db3b0 time_started = 2024-08-27 19:02:30.495980 UTC
5822024-08-27T19:02:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 840.353422ms iteration = 1 status = {"collection_id":"14574b00-bf49-4865-8491-1c34878db3b0","time_done":"2024-08-27 19:02:30.709564 UTC","time_started":"2024-08-27 19:02:30.495980 UTC"}
5832024-08-27T19:02:31.069ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
5842024-08-27T19:02:31.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5852024-08-27T19:02:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5862024-08-27T19:02:31.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872024-08-27T19:02:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5882024-08-27T19:02:31.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5892024-08-27T19:02:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5902024-08-27T19:02:31.073ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
5912024-08-27T19:02:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 4.301678ms iteration = 2 status = {"error":"rack not yet initialized: c74aab71-8e38-4613-a469-5ba1cc230991"}
5922024-08-27T19:02:31.291ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
5932024-08-27T19:02:31.291ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
5942024-08-27T19:02:31.293ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
5952024-08-27T19:02:31.293ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
5962024-08-27T19:02:31.294ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-08-27T19:02:31.297ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
5982024-08-27T19:02:31.297ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
5992024-08-27T19:02:33.298ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6002024-08-27T19:02:33.298ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6012024-08-27T19:02:33.300ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6022024-08-27T19:02:33.300ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6032024-08-27T19:02:33.324ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6042024-08-27T19:02:33.326ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6052024-08-27T19:02:33.326ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
6062024-08-27T19:02:35.327ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6072024-08-27T19:02:35.328ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6082024-08-27T19:02:35.329ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6092024-08-27T19:02:35.329ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6102024-08-27T19:02:35.330ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112024-08-27T19:02:35.332ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6122024-08-27T19:02:35.332ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
6132024-08-27T19:02:37.333ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6142024-08-27T19:02:37.334ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6152024-08-27T19:02:37.335ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6162024-08-27T19:02:37.335ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6172024-08-27T19:02:37.336ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-08-27T19:02:37.338ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6192024-08-27T19:02:37.338ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6202024-08-27T19:02:39.339ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6212024-08-27T19:02:39.340ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6222024-08-27T19:02:39.341ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6232024-08-27T19:02:39.341ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6242024-08-27T19:02:39.342ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6252024-08-27T19:02:39.345ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6262024-08-27T19:02:39.345ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6272024-08-27T19:02:40.228ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
6282024-08-27T19:02:40.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
6292024-08-27T19:02:40.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6302024-08-27T19:02:40.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6312024-08-27T19:02:40.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6322024-08-27T19:02:40.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6332024-08-27T19:02:40.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-08-27T19:02:40.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6352024-08-27T19:02:40.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6362024-08-27T19:02:40.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6372024-08-27T19:02:40.234ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6382024-08-27T19:02:40.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 5.176146ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6392024-08-27T19:02:40.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6402024-08-27T19:02:40.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6412024-08-27T19:02:40.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.360297ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6422024-08-27T19:02:41.346ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6432024-08-27T19:02:41.346ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6442024-08-27T19:02:41.347ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6452024-08-27T19:02:41.347ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6462024-08-27T19:02:41.348ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-08-27T19:02:41.350ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6482024-08-27T19:02:41.350ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6492024-08-27T19:02:43.352ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6502024-08-27T19:02:43.352ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6512024-08-27T19:02:43.353ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6522024-08-27T19:02:43.353ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6532024-08-27T19:02:43.354ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-08-27T19:02:43.357ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6552024-08-27T19:02:43.357ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6562024-08-27T19:02:45.358ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6572024-08-27T19:02:45.358ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6582024-08-27T19:02:45.360ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6592024-08-27T19:02:45.360ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6602024-08-27T19:02:45.361ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612024-08-27T19:02:45.364ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6622024-08-27T19:02:45.364ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6632024-08-27T19:02:47.364ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6642024-08-27T19:02:47.364ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6652024-08-27T19:02:47.365ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6662024-08-27T19:02:47.366ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6672024-08-27T19:02:47.367ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-08-27T19:02:47.369ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6692024-08-27T19:02:47.369ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6702024-08-27T19:02:49.370ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6712024-08-27T19:02:49.370ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6722024-08-27T19:02:49.372ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6732024-08-27T19:02:49.372ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6742024-08-27T19:02:49.373ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752024-08-27T19:02:49.376ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6762024-08-27T19:02:49.376ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6772024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
6782024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6792024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
6802024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6812024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6822024-08-27T19:02:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6832024-08-27T19:02:50.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-08-27T19:02:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6852024-08-27T19:02:50.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6862024-08-27T19:02:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6872024-08-27T19:02:50.234ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6882024-08-27T19:02:50.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 5.728317ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6892024-08-27T19:02:50.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6902024-08-27T19:02:50.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6912024-08-27T19:02:50.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.384131ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6922024-08-27T19:02:51.377ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6932024-08-27T19:02:51.378ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6942024-08-27T19:02:51.378ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6952024-08-27T19:02:51.379ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6962024-08-27T19:02:51.380ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972024-08-27T19:02:51.382ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
6982024-08-27T19:02:51.382ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
6992024-08-27T19:02:53.383ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7002024-08-27T19:02:53.384ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7012024-08-27T19:02:53.384ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7022024-08-27T19:02:53.385ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7032024-08-27T19:02:53.386ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042024-08-27T19:02:53.388ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
7052024-08-27T19:02:53.388ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
7062024-08-27T19:02:54.285ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37574
7072024-08-27T19:02:54.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = ba1b3d76-61e6-4feb-b760-08b400df573c roles = RoleSet { roles: {} } uri = /sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2
7082024-08-27T19:02:54.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = ba1b3d76-61e6-4feb-b760-08b400df573c resource = Database result = Ok(()) uri = /sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2
7092024-08-27T19:02:54.293ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "e38b401b-2d22-4589-ac73-fc644b0a15b2" error_message_internal = not found: sled with id "e38b401b-2d22-4589-ac73-fc644b0a15b2" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 7089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = ba1b3d76-61e6-4feb-b760-08b400df573c response_code = 404 uri = /sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2
7102024-08-27T19:02:54.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = b1701b7a-69cf-4ed5-9d9b-5577e25dff4f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7112024-08-27T19:02:54.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = b1701b7a-69cf-4ed5-9d9b-5577e25dff4f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7122024-08-27T19:02:54.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = b1701b7a-69cf-4ed5-9d9b-5577e25dff4f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7132024-08-27T19:02:55.159ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = e38b401b-2d22-4589-ac73-fc644b0a15b2
7142024-08-27T19:02:55.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 15653 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37574 req_id = 3ba8f930-9dd1-4b76-951f-e61b8ecadf5b response_code = 204 uri = /sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2
7152024-08-27T19:02:55.171ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
7162024-08-27T19:02:55.171ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7172024-08-27T19:02:55.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7182024-08-27T19:02:55.173ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-08-27T19:02:55.174ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7202024-08-27T19:02:55.174ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7212024-08-27T19:02:55.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7222024-08-27T19:02:55.177ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(14574b00-bf49-4865-8491-1c34878db3b0, 0), (9312cc8d-894f-444f-9fcb-772dfd18ad3c, 0), (a8d59384-02f8-4807-87eb-c98ebc8f1dfd, 0)]
7232024-08-27T19:02:55.178ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 919, tv_nsec: 832595214 } })
7242024-08-27T19:02:55.208ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
7252024-08-27T19:02:55.208ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
7262024-08-27T19:02:55.208ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
7272024-08-27T19:02:55.210ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9225581-f466-400d-8966-1a105e983873", "content-length": "476", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7282024-08-27T19:02:55.210ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
7292024-08-27T19:02:55.210ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f380cfeb-f705-425c-a4a4-aa4310b05e0e", "content-length": "734", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7302024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
7312024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54e94fb6-3b66-4c22-919f-cd2e247832af", "content-length": "86", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7322024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
7332024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "203eb367-d88c-41fe-bf73-bd38f509ddba", "content-length": "86", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7342024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
7352024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc0e0286-f296-4f4c-a574-d5f27a800190", "content-length": "80", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7362024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
7372024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d40b515f-3293-4b22-b0eb-2ce6f70fc23e", "content-length": "80", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7382024-08-27T19:02:55.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7392024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "471d1fac-b409-443d-bb14-7d5528816587", "content-length": "88", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7402024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7412024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e35f159-11a6-47bc-b121-e73685aa7d1f", "content-length": "88", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7422024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7432024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cfc91bf0-a5e3-426d-86a0-b6c921893d45", "content-length": "702", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7442024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7452024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06e9e66e-43f7-45bf-8256-02df58469297", "content-length": "727", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7462024-08-27T19:02:55.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7472024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8159b15f-0a53-442b-a10d-98c409150887", "content-length": "729", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7482024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7492024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6364b20-3ef6-4bf9-a213-74251f0d6175", "content-length": "728", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7502024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7512024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5896d3ca-56cf-4f74-9db2-d316a17a98c8", "content-length": "722", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7522024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7532024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c46aa2a1-4d96-4389-8711-efc8b041bae8", "content-length": "84", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7542024-08-27T19:02:55.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7552024-08-27T19:02:55.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b8c6c6-0c59-4da9-8e63-91f79a596249", "content-length": "84", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7562024-08-27T19:02:55.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7572024-08-27T19:02:55.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44a6e98c-09bc-4ab5-bb93-c320108cd145", "content-length": "82", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7582024-08-27T19:02:55.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7592024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77b273b1-705d-4f27-a395-72008d50d29c", "content-length": "82", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7602024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7612024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e51d8afd-27d7-4f0a-b8a9-0a762efe6c21", "content-length": "91", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7622024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7632024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf2e75b-aae3-4272-b701-ea26e49521f9", "content-length": "91", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7642024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7652024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7e3d1f35-a42f-4d10-8b8e-878f335dc357", "content-length": "702", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7662024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7672024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4408f19b-b3a0-4760-8ee4-74c07f525291", "content-length": "727", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7682024-08-27T19:02:55.215ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7692024-08-27T19:02:55.216ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f28858c2-1bb0-4bb1-a390-04b5d7f11ec9", "content-length": "729", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7702024-08-27T19:02:55.216ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7712024-08-27T19:02:55.216ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e48e8d6f-4658-4fc1-bcd5-fd2a3a88e607", "content-length": "728", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7722024-08-27T19:02:55.216ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7732024-08-27T19:02:55.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7742024-08-27T19:02:55.218ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752024-08-27T19:02:55.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7762024-08-27T19:02:55.219ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7772024-08-27T19:02:55.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7782024-08-27T19:02:55.221ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792024-08-27T19:02:55.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7802024-08-27T19:02:55.222ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7812024-08-27T19:02:55.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7822024-08-27T19:02:55.304ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
7832024-08-27T19:02:55.304ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
7842024-08-27T19:02:55.389ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7852024-08-27T19:02:55.390ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7862024-08-27T19:02:55.390ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7872024-08-27T19:02:55.391ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7882024-08-27T19:02:55.391ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892024-08-27T19:02:55.394ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
7902024-08-27T19:02:55.394ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
7912024-08-27T19:02:55.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = 5ed6cdc5-1154-47b2-8ea7-663d494408fe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7922024-08-27T19:02:55.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = 5ed6cdc5-1154-47b2-8ea7-663d494408fe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7932024-08-27T19:02:55.400ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dabec411-11b1-49b8-8ea7-8e9dad581549", "content-length": "2362", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7942024-08-27T19:02:55.400ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
7952024-08-27T19:02:55.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37574 req_id = 5ed6cdc5-1154-47b2-8ea7-663d494408fe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
7962024-08-27T19:02:55.407ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27943b44-ae41-4ae2-820c-4baabc9b427b", "content-length": "10314", "date": "Tue, 27 Aug 2024 19:02:55 GMT"} })
7972024-08-27T19:02:55.409ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7982024-08-27T19:02:55.409ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7992024-08-27T19:02:55.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8002024-08-27T19:02:55.410ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012024-08-27T19:02:55.411ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8022024-08-27T19:02:55.413ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8032024-08-27T19:02:55.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8042024-08-27T19:02:55.547ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2783d3a5-4804-4007-b389-63d0c7c3798c file = nexus/db-queries/src/db/datastore/inventory.rs:893
8052024-08-27T19:02:55.548ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2783d3a5-4804-4007-b389-63d0c7c3798c time_started = 2024-08-27 19:02:55.208549 UTC
8062024-08-27T19:02:55.548ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 377.430873ms iteration = 2 status = {"collection_id":"2783d3a5-4804-4007-b389-63d0c7c3798c","time_done":"2024-08-27 19:02:55.409087 UTC","time_started":"2024-08-27 19:02:55.208549 UTC"}
8072024-08-27T19:02:55.548ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
8082024-08-27T19:02:55.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8092024-08-27T19:02:55.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8102024-08-27T19:02:55.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112024-08-27T19:02:55.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8122024-08-27T19:02:55.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8132024-08-27T19:02:55.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8142024-08-27T19:02:55.553ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
8152024-08-27T19:02:55.553ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 4.827629ms iteration = 3 status = {"error":"rack not yet initialized: c74aab71-8e38-4613-a469-5ba1cc230991"}
8162024-08-27T19:02:55.716ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42930
8172024-08-27T19:02:55.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 027358e1-86b5-447c-8d9e-5be7f44330a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8182024-08-27T19:02:55.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 027358e1-86b5-447c-8d9e-5be7f44330a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8192024-08-27T19:02:55.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 027358e1-86b5-447c-8d9e-5be7f44330a1 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8202024-08-27T19:02:55.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = a4cad948-afd5-4c4c-9330-e55a6618229e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8212024-08-27T19:02:55.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = a4cad948-afd5-4c4c-9330-e55a6618229e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8222024-08-27T19:02:55.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = a4cad948-afd5-4c4c-9330-e55a6618229e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8232024-08-27T19:02:55.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ee2c1234-9355-40bc-bb94-bf25ca2369a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8242024-08-27T19:02:55.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ee2c1234-9355-40bc-bb94-bf25ca2369a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8252024-08-27T19:02:55.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ee2c1234-9355-40bc-bb94-bf25ca2369a6 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8262024-08-27T19:02:55.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = f2a969a3-d5a6-436d-bb9f-09688b97d653 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8272024-08-27T19:02:55.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = f2a969a3-d5a6-436d-bb9f-09688b97d653 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8282024-08-27T19:02:55.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = f2a969a3-d5a6-436d-bb9f-09688b97d653 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8292024-08-27T19:02:55.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b267e94c-046d-40ef-9130-e70bfdec1bfd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8302024-08-27T19:02:55.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b267e94c-046d-40ef-9130-e70bfdec1bfd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8312024-08-27T19:02:55.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b267e94c-046d-40ef-9130-e70bfdec1bfd response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8322024-08-27T19:02:55.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5e6550b7-a9c6-4efc-a86b-95dbdfbb3217 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8332024-08-27T19:02:55.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5e6550b7-a9c6-4efc-a86b-95dbdfbb3217 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8342024-08-27T19:02:55.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5e6550b7-a9c6-4efc-a86b-95dbdfbb3217 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8352024-08-27T19:02:55.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 161e45b1-ecf1-4aee-976c-d35cf23f4a11 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8362024-08-27T19:02:55.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 161e45b1-ecf1-4aee-976c-d35cf23f4a11 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8372024-08-27T19:02:55.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 161e45b1-ecf1-4aee-976c-d35cf23f4a11 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8382024-08-27T19:02:56.215ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:38934
8392024-08-27T19:02:56.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8171375b-e419-40fa-82cd-6b71d240ddf4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8402024-08-27T19:02:56.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8171375b-e419-40fa-82cd-6b71d240ddf4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8412024-08-27T19:02:56.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8171375b-e419-40fa-82cd-6b71d240ddf4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8422024-08-27T19:02:57.395ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8432024-08-27T19:02:57.395ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8442024-08-27T19:02:57.396ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8452024-08-27T19:02:57.396ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8462024-08-27T19:02:57.398ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472024-08-27T19:02:57.400ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
8482024-08-27T19:02:57.400ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
8492024-08-27T19:02:57.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a25042e5-3e6e-4cca-bffc-c6b6211af2cc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8502024-08-27T19:02:57.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a25042e5-3e6e-4cca-bffc-c6b6211af2cc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8512024-08-27T19:02:57.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a25042e5-3e6e-4cca-bffc-c6b6211af2cc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8522024-08-27T19:02:58.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58c1e482-f87a-4c56-bbec-adb1ba456ae1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8532024-08-27T19:02:58.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58c1e482-f87a-4c56-bbec-adb1ba456ae1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8542024-08-27T19:02:58.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58c1e482-f87a-4c56-bbec-adb1ba456ae1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8552024-08-27T19:02:59.401ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8562024-08-27T19:02:59.401ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8572024-08-27T19:02:59.403ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8582024-08-27T19:02:59.403ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8592024-08-27T19:02:59.404ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602024-08-27T19:02:59.406ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
8612024-08-27T19:02:59.406ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c74aab71-8e38-4613-a469-5ba1cc230991, time_created: 2024-08-27T19:02:31.127438Z, time_modified: 2024-08-27T19:02:31.127438Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
8622024-08-27T19:02:59.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 188a87f0-58c3-4216-ad57-110dacdf57ad roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8632024-08-27T19:02:59.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 188a87f0-58c3-4216-ad57-110dacdf57ad resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8642024-08-27T19:02:59.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 188a87f0-58c3-4216-ad57-110dacdf57ad response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
8652024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
8662024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
8672024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8682024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
8692024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8702024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8712024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
8722024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8732024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
8742024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
8752024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8762024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
8772024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
8782024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8792024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
8802024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8812024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8822024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8832024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
8842024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8852024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
8862024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
8872024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8882024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8892024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
8902024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
8912024-08-27T19:03:00.229ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
8922024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8932024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8942024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
8952024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8962024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
8972024-08-27T19:03:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8982024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8992024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9002024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9012024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9022024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9032024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9042024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9062024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9072024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9082024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9092024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9102024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9112024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9122024-08-27T19:03:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9132024-08-27T19:03:00.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142024-08-27T19:03:00.231ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.913629ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9152024-08-27T19:03:00.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9162024-08-27T19:03:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172024-08-27T19:03:00.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-08-27T19:03:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9192024-08-27T19:03:00.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9202024-08-27T19:03:00.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.808798ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
9212024-08-27T19:03:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9222024-08-27T19:03:00.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 924, tv_nsec: 890201979 } })
9232024-08-27T19:03:00.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 924, tv_nsec: 890433713 } })
9242024-08-27T19:03:00.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9252024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9262024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9272024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9282024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9292024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9302024-08-27T19:03:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9312024-08-27T19:03:00.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
9322024-08-27T19:03:00.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
9332024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9342024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9352024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9362024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9372024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9382024-08-27T19:03:00.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 924, tv_nsec: 893817782 } })
9392024-08-27T19:03:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9402024-08-27T19:03:00.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
9412024-08-27T19:03:00.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9422024-08-27T19:03:00.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9432024-08-27T19:03:00.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442024-08-27T19:03:00.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9452024-08-27T19:03:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9462024-08-27T19:03:00.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9472024-08-27T19:03:00.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482024-08-27T19:03:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9492024-08-27T19:03:00.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-08-27T19:03:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
9512024-08-27T19:03:00.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9522024-08-27T19:03:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9532024-08-27T19:03:00.254ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9542024-08-27T19:03:00.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.647613ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9552024-08-27T19:03:00.257ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
9562024-08-27T19:03:00.257ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
9572024-08-27T19:03:00.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.253646ms iteration = 4 status = {"enabled":false,"status":"first target blueprint","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z","time_found":"2024-08-27T19:03:00.257817205Z"}
9582024-08-27T19:03:00.257ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
9592024-08-27T19:03:00.257ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
9602024-08-27T19:03:00.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.121\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
9612024-08-27T19:03:00.257ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9622024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9632024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9642024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9652024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9662024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9672024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9682024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9692024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9702024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712024-08-27T19:03:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9722024-08-27T19:03:00.259ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732024-08-27T19:03:00.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9742024-08-27T19:03:00.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9752024-08-27T19:03:00.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9762024-08-27T19:03:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9772024-08-27T19:03:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9782024-08-27T19:03:00.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9792024-08-27T19:03:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9802024-08-27T19:03:00.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9812024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9822024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9832024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9842024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9852024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9862024-08-27T19:03:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9872024-08-27T19:03:00.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9882024-08-27T19:03:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9892024-08-27T19:03:00.294ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9902024-08-27T19:03:00.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9912024-08-27T19:03:00.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9922024-08-27T19:03:00.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9932024-08-27T19:03:00.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.548759ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9942024-08-27T19:03:00.299ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
9952024-08-27T19:03:00.299ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9962024-08-27T19:03:00.299ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9972024-08-27T19:03:00.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9982024-08-27T19:03:00.315ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
9992024-08-27T19:03:00.315ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10002024-08-27T19:03:00.315ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d7f66c-df4a-4f41-8cb4-7c66f30a9583", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10012024-08-27T19:03:00.315ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10022024-08-27T19:03:00.317ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10032024-08-27T19:03:00.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
10042024-08-27T19:03:00.321ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10052024-08-27T19:03:00.322ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9e83cb14-5ca7-4f80-8ed9-8b8e83aba289", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10062024-08-27T19:03:00.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10072024-08-27T19:03:00.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
10082024-08-27T19:03:00.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10092024-08-27T19:03:00.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10102024-08-27T19:03:00.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.296469ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
10112024-08-27T19:03:00.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.936224ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10122024-08-27T19:03:00.342ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10132024-08-27T19:03:00.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10142024-08-27T19:03:00.343ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10152024-08-27T19:03:00.343ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10162024-08-27T19:03:00.343ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.552348ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
10172024-08-27T19:03:00.346ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.825504ms iteration = 4 status = {"physical_disks_added":0}
10182024-08-27T19:03:00.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10192024-08-27T19:03:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10202024-08-27T19:03:00.378ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10212024-08-27T19:03:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10222024-08-27T19:03:00.389ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
10232024-08-27T19:03:00.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.71511ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10242024-08-27T19:03:00.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10252024-08-27T19:03:00.393ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10262024-08-27T19:03:00.393ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c3f80ac-eede-4f9f-9d08-927244f66803", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10272024-08-27T19:03:00.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10282024-08-27T19:03:00.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10292024-08-27T19:03:00.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10302024-08-27T19:03:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10312024-08-27T19:03:00.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10322024-08-27T19:03:00.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10332024-08-27T19:03:00.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-08-27T19:03:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
10352024-08-27T19:03:00.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10362024-08-27T19:03:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10372024-08-27T19:03:00.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10382024-08-27T19:03:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10392024-08-27T19:03:00.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10402024-08-27T19:03:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10412024-08-27T19:03:00.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-08-27T19:03:00.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10432024-08-27T19:03:00.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10442024-08-27T19:03:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10452024-08-27T19:03:00.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462024-08-27T19:03:00.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10472024-08-27T19:03:00.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10482024-08-27T19:03:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10492024-08-27T19:03:00.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502024-08-27T19:03:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10512024-08-27T19:03:00.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10522024-08-27T19:03:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10532024-08-27T19:03:00.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10542024-08-27T19:03:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10552024-08-27T19:03:00.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10562024-08-27T19:03:00.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10572024-08-27T19:03:00.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10582024-08-27T19:03:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10592024-08-27T19:03:00.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10602024-08-27T19:03:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10612024-08-27T19:03:00.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10622024-08-27T19:03:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10632024-08-27T19:03:00.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10642024-08-27T19:03:00.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10652024-08-27T19:03:00.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10662024-08-27T19:03:00.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10672024-08-27T19:03:00.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10682024-08-27T19:03:00.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10692024-08-27T19:03:00.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10702024-08-27T19:03:00.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10712024-08-27T19:03:00.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 925, tv_nsec: 100722405 } })
10722024-08-27T19:03:00.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1050
10732024-08-27T19:03:00.511ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10742024-08-27T19:03:00.511ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b04d0531-48f8-4322-98b2-a62c85936f5e", "content-length": "372", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10752024-08-27T19:03:00.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10762024-08-27T19:03:00.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10772024-08-27T19:03:00.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10782024-08-27T19:03:00.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10792024-08-27T19:03:00.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10802024-08-27T19:03:00.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10812024-08-27T19:03:00.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bdeabe2d-25f3-4954-b1be-459a4e6c37b9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
10822024-08-27T19:03:00.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bdeabe2d-25f3-4954-b1be-459a4e6c37b9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
10832024-08-27T19:03:00.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bdeabe2d-25f3-4954-b1be-459a4e6c37b9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
10842024-08-27T19:03:00.520ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10852024-08-27T19:03:00.527ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "544c361a-aaa0-458f-a69b-48ce60bd6571", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10862024-08-27T19:03:00.528ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.554654ms iteration = 2 status = {}
10872024-08-27T19:03:00.561ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 331.661389ms iteration = 2 status = {}
10882024-08-27T19:03:00.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10892024-08-27T19:03:00.627ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10902024-08-27T19:03:00.629ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "84f72ae0-ac83-4e4a-9b98-2258b17d8319", "content-length": "26", "date": "Tue, 27 Aug 2024 19:02:59 GMT"} })
10912024-08-27T19:03:00.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10922024-08-27T19:03:00.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10932024-08-27T19:03:00.652ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
10942024-08-27T19:03:00.705ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10952024-08-27T19:03:00.705ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3824f298-c05f-422a-bbdc-2abcecc52192", "content-length": "1", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
10962024-08-27T19:03:00.706ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10972024-08-27T19:03:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10982024-08-27T19:03:00.708ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 478.734331ms iteration = 2 status = null
10992024-08-27T19:03:00.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5b83d468-6395-4df4-8ba5-2ba619974644 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11002024-08-27T19:03:00.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5b83d468-6395-4df4-8ba5-2ba619974644 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11012024-08-27T19:03:00.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5b83d468-6395-4df4-8ba5-2ba619974644 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11022024-08-27T19:03:00.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = d59d42d5-fdc4-4144-8b33-7e9a0262e70d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
11032024-08-27T19:03:00.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = d59d42d5-fdc4-4144-8b33-7e9a0262e70d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
11042024-08-27T19:03:00.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = d59d42d5-fdc4-4144-8b33-7e9a0262e70d response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
11052024-08-27T19:03:00.759ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
11062024-08-27T19:03:00.759ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed97437-b4ee-405a-a236-584cf3552dbc", "content-length": "4", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11072024-08-27T19:03:00.761ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 531.473687ms iteration = 2 status = 6
11082024-08-27T19:03:00.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11092024-08-27T19:03:00.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11102024-08-27T19:03:00.781ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
11112024-08-27T19:03:00.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11122024-08-27T19:03:00.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11132024-08-27T19:03:00.788ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11142024-08-27T19:03:00.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11152024-08-27T19:03:00.796ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f563c514-6edc-4192-9ba7-7da121c63c2e", "content-length": "121", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11162024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11172024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
11182024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11192024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11202024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
11212024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
11222024-08-27T19:03:00.796ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
11232024-08-27T19:03:00.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11242024-08-27T19:03:00.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11252024-08-27T19:03:00.798ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11262024-08-27T19:03:00.798ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0077dd50-f9c8-43c6-9c46-5deccbfce2de", "content-length": "2", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11272024-08-27T19:03:00.798ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11282024-08-27T19:03:00.798ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7b6ba284-766b-4145-a35d-6350c521545f", "content-length": "52", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11292024-08-27T19:03:00.798ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
11302024-08-27T19:03:00.798ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11312024-08-27T19:03:00.803ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
11322024-08-27T19:03:00.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11332024-08-27T19:03:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11342024-08-27T19:03:00.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11352024-08-27T19:03:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11362024-08-27T19:03:00.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-08-27T19:03:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11382024-08-27T19:03:00.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11392024-08-27T19:03:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11402024-08-27T19:03:00.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-08-27T19:03:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11422024-08-27T19:03:00.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11432024-08-27T19:03:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11442024-08-27T19:03:00.845ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
11452024-08-27T19:03:00.879ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
11462024-08-27T19:03:00.885ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e93e3745-4150-4398-93b7-d54ed0b7ffe8", "content-length": "691", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11472024-08-27T19:03:00.885ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11482024-08-27T19:03:00.886ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11492024-08-27T19:03:00.886ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11502024-08-27T19:03:00.887ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 657.564381ms iteration = 2 status = {}
11512024-08-27T19:03:00.913ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
11522024-08-27T19:03:00.996ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7a5f8890-ec5c-4422-8437-bd06ff785554", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11532024-08-27T19:03:00.996ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
11542024-08-27T19:03:00.996ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11552024-08-27T19:03:00.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "829fe323-eeaf-4889-a368-8ab5179e83c7", "content-length": "667", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
11562024-08-27T19:03:00.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11572024-08-27T19:03:00.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11582024-08-27T19:03:01.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11592024-08-27T19:03:01.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11602024-08-27T19:03:01.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11612024-08-27T19:03:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11622024-08-27T19:03:01.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11632024-08-27T19:03:01.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11642024-08-27T19:03:01.013ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 784.030722ms iteration = 2 status = {}
11652024-08-27T19:03:01.407ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11662024-08-27T19:03:01.408ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11672024-08-27T19:03:01.409ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11682024-08-27T19:03:01.409ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11692024-08-27T19:03:01.410ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702024-08-27T19:03:01.413ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c74aab71-8e38-4613-a469-5ba1cc230991, lookup_type: ById(c74aab71-8e38-4613-a469-5ba1cc230991) } result = Ok(())
11712024-08-27T19:03:01.413ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:762
11722024-08-27T19:03:01.413ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11732024-08-27T19:03:01.413ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11742024-08-27T19:03:01.414ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11752024-08-27T19:03:01.414ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11762024-08-27T19:03:01.416ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11772024-08-27T19:03:01.416ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11782024-08-27T19:03:01.417ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11792024-08-27T19:03:01.417ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11802024-08-27T19:03:01.418ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11812024-08-27T19:03:01.419ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11822024-08-27T19:03:01.420ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11832024-08-27T19:03:01.420ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11842024-08-27T19:03:01.421ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-08-27T19:03:01.425ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11862024-08-27T19:03:01.425ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11872024-08-27T19:03:01.425ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11882024-08-27T19:03:01.426ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11892024-08-27T19:03:01.426ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11902024-08-27T19:03:01.427ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11912024-08-27T19:03:01.427ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11922024-08-27T19:03:01.428ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-08-27T19:03:01.431ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11942024-08-27T19:03:01.431ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11952024-08-27T19:03:01.431ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11962024-08-27T19:03:01.435ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11972024-08-27T19:03:01.435ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11982024-08-27T19:03:01.436ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11992024-08-27T19:03:01.436ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12002024-08-27T19:03:01.437ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12012024-08-27T19:03:01.438ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12022024-08-27T19:03:01.438ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12032024-08-27T19:03:01.439ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12042024-08-27T19:03:01.439ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12052024-08-27T19:03:01.440ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12062024-08-27T19:03:01.440ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12072024-08-27T19:03:01.441ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12082024-08-27T19:03:01.441ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12092024-08-27T19:03:01.445ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12102024-08-27T19:03:01.445ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12112024-08-27T19:03:01.445ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12122024-08-27T19:03:01.446ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12132024-08-27T19:03:01.446ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12142024-08-27T19:03:01.448ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12152024-08-27T19:03:01.448ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12162024-08-27T19:03:01.450ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12172024-08-27T19:03:01.450ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12182024-08-27T19:03:01.451ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12192024-08-27T19:03:01.451ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12202024-08-27T19:03:01.452ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12212024-08-27T19:03:01.452ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12222024-08-27T19:03:01.453ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12232024-08-27T19:03:01.453ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12242024-08-27T19:03:01.454ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-08-27T19:03:01.457ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12262024-08-27T19:03:01.457ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12272024-08-27T19:03:01.458ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12282024-08-27T19:03:01.458ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12292024-08-27T19:03:01.458ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12302024-08-27T19:03:01.459ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12312024-08-27T19:03:01.459ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12322024-08-27T19:03:01.460ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12332024-08-27T19:03:01.464ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12342024-08-27T19:03:01.464ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12352024-08-27T19:03:01.464ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12362024-08-27T19:03:01.467ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12372024-08-27T19:03:01.467ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12382024-08-27T19:03:01.468ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12392024-08-27T19:03:01.469ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12402024-08-27T19:03:01.470ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12412024-08-27T19:03:01.470ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12422024-08-27T19:03:01.472ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12432024-08-27T19:03:01.472ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12442024-08-27T19:03:01.474ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12452024-08-27T19:03:01.474ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12462024-08-27T19:03:01.475ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12472024-08-27T19:03:01.475ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12482024-08-27T19:03:01.476ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12492024-08-27T19:03:01.476ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12502024-08-27T19:03:01.477ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12512024-08-27T19:03:01.480ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12522024-08-27T19:03:01.480ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12532024-08-27T19:03:01.480ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12542024-08-27T19:03:01.481ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12552024-08-27T19:03:01.481ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12562024-08-27T19:03:01.482ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12572024-08-27T19:03:01.482ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12582024-08-27T19:03:01.483ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-08-27T19:03:01.488ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12602024-08-27T19:03:01.488ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12612024-08-27T19:03:01.488ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12622024-08-27T19:03:01.493ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
12632024-08-27T19:03:01.493ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12642024-08-27T19:03:01.493ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12652024-08-27T19:03:01.494ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12662024-08-27T19:03:01.496ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
12672024-08-27T19:03:01.496ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12682024-08-27T19:03:01.496ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12692024-08-27T19:03:01.497ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12702024-08-27T19:03:01.499ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12712024-08-27T19:03:01.499ZDEBGnexus (InternalApi): resolved 2 rules for sleds
12722024-08-27T19:03:01.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 186bb242-8012-4b14-8005-09f505ef9745 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
12732024-08-27T19:03:01.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 186bb242-8012-4b14-8005-09f505ef9745 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
12742024-08-27T19:03:01.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 186bb242-8012-4b14-8005-09f505ef9745 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
12752024-08-27T19:03:01.556ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: e38b401b-2d22-4589-ac73-fc644b0a15b2, time_created: 2024-08-27T19:02:55.159379Z, time_modified: 2024-08-27T19:02:55.159379Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12762024-08-27T19:03:01.556ZDEBGnexus (InternalApi): sending firewall rules to sled agents
12772024-08-27T19:03:01.556ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12782024-08-27T19:03:01.556ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12792024-08-27T19:03:01.558ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12802024-08-27T19:03:01.558ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12812024-08-27T19:03:01.559ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-08-27T19:03:01.562ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
12832024-08-27T19:03:01.595ZDEBGnexus (InternalApi): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12842024-08-27T19:03:01.595ZDEBGnexus (InternalApi): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "df70a79a-bc87-4539-95d4-62ce926944ab", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
12852024-08-27T19:03:01.596ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12862024-08-27T19:03:01.596ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
12872024-08-27T19:03:01.731ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca404f24-4d88-4003-b232-bf3eade7ceb0", "content-length": "64", "date": "Tue, 27 Aug 2024 19:03:00 GMT"} })
12882024-08-27T19:03:01.731ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12892024-08-27T19:03:01.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12902024-08-27T19:03:01.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912024-08-27T19:03:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12922024-08-27T19:03:01.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12932024-08-27T19:03:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12942024-08-27T19:03:01.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ff5c4a2c-2099-4bb0-abcf-a4abd2bf7e53 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
12952024-08-27T19:03:01.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ff5c4a2c-2099-4bb0-abcf-a4abd2bf7e53 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
12962024-08-27T19:03:01.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ff5c4a2c-2099-4bb0-abcf-a4abd2bf7e53 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
12972024-08-27T19:03:01.785ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "20ce2489-ff4f-4cf6-b43f-257d3880c6f9", "content-length": "64", "date": "Tue, 27 Aug 2024 19:03:01 GMT"} })
12982024-08-27T19:03:01.785ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12992024-08-27T19:03:01.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13002024-08-27T19:03:01.786ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-08-27T19:03:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13022024-08-27T19:03:01.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13032024-08-27T19:03:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13042024-08-27T19:03:01.829ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "48b0ae35-a116-468b-8807-fcfdb4506fb6", "content-length": "64", "date": "Tue, 27 Aug 2024 19:03:01 GMT"} })
13052024-08-27T19:03:01.829ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13062024-08-27T19:03:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13072024-08-27T19:03:01.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-08-27T19:03:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13092024-08-27T19:03:01.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13102024-08-27T19:03:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13112024-08-27T19:03:01.837ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9782bbd0-bb26-4e91-8d46-f0f21a9daeea", "content-length": "64", "date": "Tue, 27 Aug 2024 19:03:01 GMT"} })
13122024-08-27T19:03:01.837ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13132024-08-27T19:03:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13142024-08-27T19:03:01.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-08-27T19:03:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13162024-08-27T19:03:01.840ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13172024-08-27T19:03:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13182024-08-27T19:03:02.089ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ef18e87-6357-4790-b633-620b58513cec", "content-length": "64", "date": "Tue, 27 Aug 2024 19:03:02 GMT"} })
13192024-08-27T19:03:02.089ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13202024-08-27T19:03:02.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13212024-08-27T19:03:02.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222024-08-27T19:03:02.092ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13232024-08-27T19:03:02.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13242024-08-27T19:03:02.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13252024-08-27T19:03:02.102ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.844387553s iteration = 2 status = {"nsuccess":5}
13262024-08-27T19:03:02.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8f8f906-380f-4bfe-b4f1-d4c3efdc95ac roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13272024-08-27T19:03:02.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8f8f906-380f-4bfe-b4f1-d4c3efdc95ac resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13282024-08-27T19:03:02.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8f8f906-380f-4bfe-b4f1-d4c3efdc95ac response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13292024-08-27T19:03:03.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74d4bd71-0545-4d3a-98e5-481b52b4bc3e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13302024-08-27T19:03:03.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74d4bd71-0545-4d3a-98e5-481b52b4bc3e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13312024-08-27T19:03:03.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74d4bd71-0545-4d3a-98e5-481b52b4bc3e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13322024-08-27T19:03:04.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6904c01-3ec2-4135-9304-3b751eca2a9c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13332024-08-27T19:03:04.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6904c01-3ec2-4135-9304-3b751eca2a9c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13342024-08-27T19:03:04.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6904c01-3ec2-4135-9304-3b751eca2a9c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13352024-08-27T19:03:05.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a8704a-a39a-4fc7-bd4c-3e2e6cb9f138 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13362024-08-27T19:03:05.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a8704a-a39a-4fc7-bd4c-3e2e6cb9f138 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13372024-08-27T19:03:05.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a8704a-a39a-4fc7-bd4c-3e2e6cb9f138 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13382024-08-27T19:03:06.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a0928b7-b6cd-4a4d-9320-6daae4868dd4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13392024-08-27T19:03:06.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a0928b7-b6cd-4a4d-9320-6daae4868dd4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13402024-08-27T19:03:06.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a0928b7-b6cd-4a4d-9320-6daae4868dd4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13412024-08-27T19:03:07.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b7e6d254-0d3c-4771-b761-0613d5eb95d9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13422024-08-27T19:03:07.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b7e6d254-0d3c-4771-b761-0613d5eb95d9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13432024-08-27T19:03:07.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b7e6d254-0d3c-4771-b761-0613d5eb95d9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13442024-08-27T19:03:08.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9fe218b2-23d7-4169-bc9d-3db115865862 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13452024-08-27T19:03:08.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9fe218b2-23d7-4169-bc9d-3db115865862 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13462024-08-27T19:03:08.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9fe218b2-23d7-4169-bc9d-3db115865862 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13472024-08-27T19:03:09.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6c788609-5563-414c-abff-3b03b66069e7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13482024-08-27T19:03:09.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6c788609-5563-414c-abff-3b03b66069e7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13492024-08-27T19:03:09.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6c788609-5563-414c-abff-3b03b66069e7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13502024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
13512024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
13522024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13532024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13552024-08-27T19:03:10.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13562024-08-27T19:03:10.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13572024-08-27T19:03:10.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582024-08-27T19:03:10.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13592024-08-27T19:03:10.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.635604ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13602024-08-27T19:03:10.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13612024-08-27T19:03:10.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13622024-08-27T19:03:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13632024-08-27T19:03:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13642024-08-27T19:03:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13652024-08-27T19:03:10.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13662024-08-27T19:03:10.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
13672024-08-27T19:03:10.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13682024-08-27T19:03:10.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13692024-08-27T19:03:10.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
13702024-08-27T19:03:10.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.898604ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
13712024-08-27T19:03:10.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4e738fc-56b5-4cca-8632-a7491f8f4836 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13722024-08-27T19:03:10.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4e738fc-56b5-4cca-8632-a7491f8f4836 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13732024-08-27T19:03:10.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4e738fc-56b5-4cca-8632-a7491f8f4836 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13742024-08-27T19:03:11.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3faa7e58-2533-4ddb-b31b-0c38abfee238 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13752024-08-27T19:03:11.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3faa7e58-2533-4ddb-b31b-0c38abfee238 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13762024-08-27T19:03:11.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3faa7e58-2533-4ddb-b31b-0c38abfee238 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13772024-08-27T19:03:12.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c0422766-beab-4800-a58f-55125fb29706 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13782024-08-27T19:03:12.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c0422766-beab-4800-a58f-55125fb29706 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13792024-08-27T19:03:12.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c0422766-beab-4800-a58f-55125fb29706 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13802024-08-27T19:03:13.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a1495284-78dc-4c0f-b633-bb1f4c6432dd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13812024-08-27T19:03:13.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a1495284-78dc-4c0f-b633-bb1f4c6432dd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13822024-08-27T19:03:13.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a1495284-78dc-4c0f-b633-bb1f4c6432dd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13832024-08-27T19:03:14.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8c32f87-fece-45e2-ac28-0dd8bbdf1ccd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13842024-08-27T19:03:14.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8c32f87-fece-45e2-ac28-0dd8bbdf1ccd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13852024-08-27T19:03:14.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a8c32f87-fece-45e2-ac28-0dd8bbdf1ccd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13862024-08-27T19:03:15.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 90a62caa-eca9-4559-ac90-ddd2944667bc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13872024-08-27T19:03:15.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 90a62caa-eca9-4559-ac90-ddd2944667bc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13882024-08-27T19:03:15.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 90a62caa-eca9-4559-ac90-ddd2944667bc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13892024-08-27T19:03:16.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83cf8784-3082-4bf8-8794-e60cdf197108 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13902024-08-27T19:03:16.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83cf8784-3082-4bf8-8794-e60cdf197108 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13912024-08-27T19:03:16.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83cf8784-3082-4bf8-8794-e60cdf197108 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13922024-08-27T19:03:17.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cef496a0-6d3c-4415-a073-6bdadd609fa6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13932024-08-27T19:03:17.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cef496a0-6d3c-4415-a073-6bdadd609fa6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13942024-08-27T19:03:17.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cef496a0-6d3c-4415-a073-6bdadd609fa6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13952024-08-27T19:03:18.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97cfd7e3-59a6-41b5-921e-43fc36b6ac95 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13962024-08-27T19:03:18.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97cfd7e3-59a6-41b5-921e-43fc36b6ac95 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13972024-08-27T19:03:18.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97cfd7e3-59a6-41b5-921e-43fc36b6ac95 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13982024-08-27T19:03:19.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02c5695c-01b4-4001-8006-b068433f0351 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
13992024-08-27T19:03:19.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02c5695c-01b4-4001-8006-b068433f0351 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14002024-08-27T19:03:19.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02c5695c-01b4-4001-8006-b068433f0351 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14012024-08-27T19:03:20.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
14022024-08-27T19:03:20.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
14032024-08-27T19:03:20.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14042024-08-27T19:03:20.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14052024-08-27T19:03:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14062024-08-27T19:03:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14072024-08-27T19:03:20.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082024-08-27T19:03:20.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14092024-08-27T19:03:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14102024-08-27T19:03:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14112024-08-27T19:03:20.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14122024-08-27T19:03:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14132024-08-27T19:03:20.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14142024-08-27T19:03:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14152024-08-27T19:03:20.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14162024-08-27T19:03:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
14172024-08-27T19:03:20.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14182024-08-27T19:03:20.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14192024-08-27T19:03:20.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
14202024-08-27T19:03:20.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.750751ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
14212024-08-27T19:03:20.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.441951ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14222024-08-27T19:03:20.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f6d0c74-f20d-447f-848f-088c1860d1ab roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14232024-08-27T19:03:20.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f6d0c74-f20d-447f-848f-088c1860d1ab resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14242024-08-27T19:03:20.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f6d0c74-f20d-447f-848f-088c1860d1ab response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14252024-08-27T19:03:21.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee48bd6b-5ae1-40d6-b2ed-e8a4fde49d89 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14262024-08-27T19:03:21.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee48bd6b-5ae1-40d6-b2ed-e8a4fde49d89 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14272024-08-27T19:03:21.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee48bd6b-5ae1-40d6-b2ed-e8a4fde49d89 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14282024-08-27T19:03:22.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dc02c1f2-ab53-4266-aff5-b7851258f85d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14292024-08-27T19:03:22.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dc02c1f2-ab53-4266-aff5-b7851258f85d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14302024-08-27T19:03:22.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dc02c1f2-ab53-4266-aff5-b7851258f85d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14312024-08-27T19:03:24.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 344f97ef-5983-4b57-9849-54361d42af88 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14322024-08-27T19:03:24.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 344f97ef-5983-4b57-9849-54361d42af88 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14332024-08-27T19:03:24.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 344f97ef-5983-4b57-9849-54361d42af88 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14342024-08-27T19:03:25.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d98680fb-d363-4aa0-83c2-4ca3c4ae20bd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14352024-08-27T19:03:25.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d98680fb-d363-4aa0-83c2-4ca3c4ae20bd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14362024-08-27T19:03:25.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d98680fb-d363-4aa0-83c2-4ca3c4ae20bd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14372024-08-27T19:03:26.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 721fd9a0-1c02-4871-8d2e-d1ba07cbf54f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14382024-08-27T19:03:26.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 721fd9a0-1c02-4871-8d2e-d1ba07cbf54f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14392024-08-27T19:03:26.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 721fd9a0-1c02-4871-8d2e-d1ba07cbf54f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14402024-08-27T19:03:27.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e8e7d70-2db1-484c-afac-a0f5c8cf63a8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14412024-08-27T19:03:27.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e8e7d70-2db1-484c-afac-a0f5c8cf63a8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14422024-08-27T19:03:27.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e8e7d70-2db1-484c-afac-a0f5c8cf63a8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14432024-08-27T19:03:28.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160cb7a2-da71-41cb-be42-935b0c907c59 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14442024-08-27T19:03:28.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160cb7a2-da71-41cb-be42-935b0c907c59 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14452024-08-27T19:03:28.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160cb7a2-da71-41cb-be42-935b0c907c59 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14462024-08-27T19:03:29.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac5f451b-e8cc-4427-b97c-1e4cb7dd4443 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14472024-08-27T19:03:29.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac5f451b-e8cc-4427-b97c-1e4cb7dd4443 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14482024-08-27T19:03:29.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac5f451b-e8cc-4427-b97c-1e4cb7dd4443 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14492024-08-27T19:03:30.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a623924b-7a63-4c6c-9474-cb8af3f04561 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14502024-08-27T19:03:30.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a623924b-7a63-4c6c-9474-cb8af3f04561 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14512024-08-27T19:03:30.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a623924b-7a63-4c6c-9474-cb8af3f04561 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
14522024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
14532024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
14542024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14552024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
14562024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
14572024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
14582024-08-27T19:03:30.229ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14592024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14602024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14612024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
14622024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14632024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
14642024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
14652024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14662024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14672024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14682024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
14692024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
14702024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
14712024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14722024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14732024-08-27T19:03:30.229ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
14742024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
14752024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.64\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
14762024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14772024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
14782024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14792024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14802024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
14812024-08-27T19:03:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
14822024-08-27T19:03:30.229ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:53:30.229830652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14832024-08-27T19:03:30.230ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
14842024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14852024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 11.99\u{b5}s iteration = 3 status = {"error":"no config"}
14862024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
14872024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
14882024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
14892024-08-27T19:03:30.230ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
14902024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14912024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 12.12\u{b5}s iteration = 3 status = {"error":"no config"}
14922024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
14932024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
14942024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14952024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14962024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14972024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
14982024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14992024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
15002024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15012024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
15022024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
15032024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
15042024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15052024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
15062024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15072024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
15082024-08-27T19:03:30.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
15092024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
15102024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15112024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15122024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15132024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15142024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
15152024-08-27T19:03:30.230ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
15162024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15172024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15182024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15192024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15202024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15212024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15222024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15232024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15242024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15252024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15262024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15272024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15282024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15292024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15302024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15312024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15322024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15332024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15342024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15352024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15362024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15372024-08-27T19:03:30.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15382024-08-27T19:03:30.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15392024-08-27T19:03:30.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-08-27T19:03:30.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15412024-08-27T19:03:30.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 885914821 } })
15422024-08-27T19:03:30.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 886074114 } })
15432024-08-27T19:03:30.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-08-27T19:03:30.233ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.588913ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15452024-08-27T19:03:30.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15462024-08-27T19:03:30.233ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-08-27T19:03:30.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482024-08-27T19:03:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15492024-08-27T19:03:30.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502024-08-27T19:03:30.234ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15512024-08-27T19:03:30.234ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.018093ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15522024-08-27T19:03:30.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532024-08-27T19:03:30.236ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
15542024-08-27T19:03:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.85933ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
15552024-08-27T19:03:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15562024-08-27T19:03:30.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15572024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15582024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15592024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15602024-08-27T19:03:30.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 891282580 } })
15612024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15622024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15632024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15642024-08-27T19:03:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15652024-08-27T19:03:30.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
15662024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15672024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15682024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15692024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15702024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15712024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15722024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15732024-08-27T19:03:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15742024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15752024-08-27T19:03:30.240ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:53:30.229830652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15762024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.379892ms iteration = 2 status = {"expiration":"2024-08-27T18:53:30.229830652Z","pruned":[]}
15772024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15782024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15792024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15802024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15812024-08-27T19:03:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15822024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15832024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15842024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15852024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15862024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15882024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15892024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15902024-08-27T19:03:30.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15912024-08-27T19:03:30.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 895678680 } })
15922024-08-27T19:03:30.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
15932024-08-27T19:03:30.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15942024-08-27T19:03:30.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15952024-08-27T19:03:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15962024-08-27T19:03:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15972024-08-27T19:03:30.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15982024-08-27T19:03:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15992024-08-27T19:03:30.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16002024-08-27T19:03:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-08-27T19:03:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16022024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16032024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16042024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16052024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16062024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16072024-08-27T19:03:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16082024-08-27T19:03:30.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-08-27T19:03:30.254ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
16102024-08-27T19:03:30.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 24.218744ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16112024-08-27T19:03:30.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16122024-08-27T19:03:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16132024-08-27T19:03:30.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16142024-08-27T19:03:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16152024-08-27T19:03:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16162024-08-27T19:03:30.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.948079ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16172024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16182024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16192024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16202024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16212024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16222024-08-27T19:03:30.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232024-08-27T19:03:30.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242024-08-27T19:03:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16252024-08-27T19:03:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16262024-08-27T19:03:30.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16272024-08-27T19:03:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16282024-08-27T19:03:30.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16292024-08-27T19:03:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16302024-08-27T19:03:30.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16312024-08-27T19:03:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16322024-08-27T19:03:30.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-08-27T19:03:30.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16342024-08-27T19:03:30.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16352024-08-27T19:03:30.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16362024-08-27T19:03:30.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372024-08-27T19:03:30.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16382024-08-27T19:03:30.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16392024-08-27T19:03:30.300ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16402024-08-27T19:03:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16412024-08-27T19:03:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16422024-08-27T19:03:30.301ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
16432024-08-27T19:03:30.301ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
16442024-08-27T19:03:30.301ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.408867ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
16452024-08-27T19:03:30.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.666703ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
16462024-08-27T19:03:30.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16472024-08-27T19:03:30.318ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16482024-08-27T19:03:30.318ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cdeb8b69-d0e2-4fe8-a763-7fb79340cc11", "content-length": "26", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
16492024-08-27T19:03:30.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16502024-08-27T19:03:30.319ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16512024-08-27T19:03:30.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.329654ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16522024-08-27T19:03:30.320ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16532024-08-27T19:03:30.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16542024-08-27T19:03:30.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16552024-08-27T19:03:30.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562024-08-27T19:03:30.323ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
16572024-08-27T19:03:30.323ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16582024-08-27T19:03:30.323ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d4d6b30-246a-4232-922d-7974fbe7d51b", "content-length": "26", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
16592024-08-27T19:03:30.323ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16602024-08-27T19:03:30.325ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
16612024-08-27T19:03:30.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
16622024-08-27T19:03:30.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16632024-08-27T19:03:30.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16642024-08-27T19:03:30.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16652024-08-27T19:03:30.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16662024-08-27T19:03:30.329ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
16672024-08-27T19:03:30.329ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16682024-08-27T19:03:30.329ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16692024-08-27T19:03:30.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16702024-08-27T19:03:30.330ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16712024-08-27T19:03:30.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16722024-08-27T19:03:30.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16732024-08-27T19:03:30.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16742024-08-27T19:03:30.334ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
16752024-08-27T19:03:30.334ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.091915ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
16762024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.394471ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
16772024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16782024-08-27T19:03:30.336ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16792024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.787559ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16802024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16812024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16822024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16832024-08-27T19:03:30.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16842024-08-27T19:03:30.337ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 990941374 } })
16852024-08-27T19:03:30.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16862024-08-27T19:03:30.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16872024-08-27T19:03:30.338ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
16882024-08-27T19:03:30.339ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.040586ms iteration = 5 status = {"physical_disks_added":0}
16892024-08-27T19:03:30.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16902024-08-27T19:03:30.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16912024-08-27T19:03:30.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16922024-08-27T19:03:30.358ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16932024-08-27T19:03:30.359ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a47aa68f-28f8-4ee2-ac4f-93b7a1414c2c", "content-length": "372", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
16942024-08-27T19:03:30.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16952024-08-27T19:03:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16962024-08-27T19:03:30.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16972024-08-27T19:03:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16982024-08-27T19:03:30.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.435454ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16992024-08-27T19:03:30.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17002024-08-27T19:03:30.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17012024-08-27T19:03:30.367ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17022024-08-27T19:03:30.368ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ddf56089-b265-41bc-b62f-0db0a15b1814", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
17032024-08-27T19:03:30.370ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 140.045088ms iteration = 3 status = {}
17042024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17052024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17062024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17072024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17082024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17092024-08-27T19:03:30.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17102024-08-27T19:03:30.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-08-27T19:03:30.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17122024-08-27T19:03:30.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17132024-08-27T19:03:30.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-08-27T19:03:30.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17152024-08-27T19:03:30.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17162024-08-27T19:03:30.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17172024-08-27T19:03:30.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
17182024-08-27T19:03:30.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17192024-08-27T19:03:30.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17202024-08-27T19:03:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 164.17113ms iteration = 3 status = 0
17212024-08-27T19:03:30.394ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
17222024-08-27T19:03:30.394ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17232024-08-27T19:03:30.394ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
17242024-08-27T19:03:30.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 164.793863ms iteration = 2 status = {"generation":1}
17252024-08-27T19:03:30.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
17262024-08-27T19:03:30.395ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
17272024-08-27T19:03:30.395ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17282024-08-27T19:03:30.395ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.357726ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
17292024-08-27T19:03:30.396ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
17302024-08-27T19:03:30.396ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.122471ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17312024-08-27T19:03:30.398ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17322024-08-27T19:03:30.398ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
17332024-08-27T19:03:30.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17342024-08-27T19:03:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17352024-08-27T19:03:30.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362024-08-27T19:03:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17372024-08-27T19:03:30.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17382024-08-27T19:03:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17392024-08-27T19:03:30.404ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
17402024-08-27T19:03:30.404ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17412024-08-27T19:03:30.404ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
17422024-08-27T19:03:30.404ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.217996ms iteration = 2 status = {"generation":2}
17432024-08-27T19:03:30.404ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
17442024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
17452024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
17462024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
17472024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
17482024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
17492024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
17502024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
17512024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
17522024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
17532024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
17542024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
17552024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
17562024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
17572024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
17582024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
17592024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
17602024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
17612024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
17622024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
17632024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
17642024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
17652024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
17662024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
17672024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
17682024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
17692024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
17702024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
17712024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
17722024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
17732024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
17742024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
17752024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
17762024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
17772024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
17782024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
17792024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
17802024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
17812024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
17822024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
17832024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
17842024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
17852024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
17862024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
17872024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
17882024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
17892024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
17902024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
17912024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
17922024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
17932024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
17942024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
17952024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
17962024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
17972024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
17982024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
17992024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
18002024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
18012024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
18022024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
18032024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
18042024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
18052024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
18062024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
18072024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
18082024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
18092024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
18102024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
18112024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
18122024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
18132024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
18142024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
18152024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
18162024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
18172024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
18182024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
18192024-08-27T19:03:30.416ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
18202024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
18212024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
18222024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
18232024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
18242024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
18252024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
18262024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
18272024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
18282024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
18292024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
18302024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
18312024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
18322024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
18332024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
18342024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
18352024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
18362024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
18372024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
18382024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
18392024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
18402024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
18412024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
18422024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
18432024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
18442024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
18452024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
18462024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
18472024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
18482024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
18492024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
18502024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
18512024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
18522024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
18532024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
18542024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
18552024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
18562024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
18572024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
18582024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
18592024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
18602024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
18612024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
18622024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
18632024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
18642024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
18652024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
18662024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
18672024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
18682024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
18692024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
18702024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
18712024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
18722024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
18732024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
18742024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
18752024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
18762024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
18772024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
18782024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
18792024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
18802024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
18812024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
18822024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
18832024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
18842024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
18852024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
18862024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
18872024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
18882024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
18892024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
18902024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
18912024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
18922024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
18932024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
18942024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
18952024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set
18962024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set
18972024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
18982024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
18992024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported
19002024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
19012024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
19022024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
19032024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
19042024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
19052024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
19062024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
19072024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
19082024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
19092024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
19102024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
19112024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
19122024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
19132024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
19142024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
19152024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
19162024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
19172024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
19182024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
19192024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
19202024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
19212024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
19222024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
19232024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
19242024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
19252024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
19262024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
19272024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
19282024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
19292024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
19302024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
19312024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
19322024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
19332024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
19342024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
19352024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
19362024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
19372024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
19382024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
19392024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
19402024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
19412024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
19422024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
19432024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
19442024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
19452024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
19462024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
19472024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
19482024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
19492024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
19502024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
19512024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
19522024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
19532024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
19542024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
19552024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
19562024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
19572024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
19582024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
19592024-08-27T19:03:30.417ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = 172.30.2.6:443
19602024-08-27T19:03:30.417ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
19612024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
19622024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
19632024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
19642024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
19652024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
19662024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
19672024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
19682024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
19692024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
19702024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
19712024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
19722024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
19732024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
19742024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
19752024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
19762024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
19772024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
19782024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19792024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
19802024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
19812024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
19822024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
19832024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
19842024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
19852024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
19862024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
19872024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
19882024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
19892024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
19902024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
19912024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
19922024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
19932024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
19942024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
19952024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
19962024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
19972024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
19982024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
19992024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
20002024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
20012024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
20022024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
20032024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
20042024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
20052024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
20062024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
20072024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
20082024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
20092024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
20102024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
20112024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
20122024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
20132024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
20142024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
20152024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
20162024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
20172024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
20182024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
20192024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
20202024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
20212024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
20222024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
20232024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
20242024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
20252024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
20262024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
20272024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
20282024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
20292024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
20302024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
20312024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
20322024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
20332024-08-27T19:03:30.422ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
20342024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
20352024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
20362024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
20372024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
20382024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
20392024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
20402024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
20412024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
20422024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
20432024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
20442024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
20452024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
20462024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
20472024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
20482024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
20492024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
20502024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
20512024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
20522024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
20532024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
20542024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
20552024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
20562024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
20572024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
20582024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
20592024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
20602024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
20612024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
20622024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
20632024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
20642024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
20652024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
20662024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
20672024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
20682024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
20692024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
20702024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
20712024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
20722024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20732024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
20742024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
20752024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
20762024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
20772024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
20782024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20792024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20802024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
20812024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
20822024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
20832024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
20842024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
20852024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
20862024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
20872024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
20882024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20892024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20902024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
20912024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
20922024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20932024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20942024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
20952024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
20962024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
20972024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
20982024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
20992024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
21002024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
21012024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
21022024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
21032024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
21042024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
21052024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
21062024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
21072024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
21082024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
21092024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
21102024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
21112024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
21122024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set
21132024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
21142024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
21152024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
21162024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported
21172024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
21182024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
21192024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
21202024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
21212024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
21222024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
21232024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
21242024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
21252024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
21262024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
21272024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
21282024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
21292024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
21302024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
21312024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
21322024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
21332024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
21342024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
21352024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
21362024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
21372024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
21382024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
21392024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
21402024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
21412024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
21422024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
21432024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
21442024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
21452024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
21462024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
21472024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
21482024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
21492024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
21502024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
21512024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
21522024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
21532024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
21542024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
21552024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
21562024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
21572024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
21582024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
21592024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
21602024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
21612024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
21622024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
21632024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
21642024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
21652024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
21662024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
21672024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
21682024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
21692024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
21702024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
21712024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
21722024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
21732024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
21742024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
21752024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
21762024-08-27T19:03:30.423ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12228
21772024-08-27T19:03:30.423ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
21782024-08-27T19:03:30.425ZDEBGnexus (nexus-producer-server): registered DTrace probes
21792024-08-27T19:03:30.440ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:40792 method = GET path = /{producer_id}
21802024-08-27T19:03:30.440ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:40792
21812024-08-27T19:03:30.440ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:40792
21822024-08-27T19:03:30.440ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:40792
21832024-08-27T19:03:30.440ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
21842024-08-27T19:03:30.440ZDEBGnexus (nexus-producer-server): starting producer registration task
21852024-08-27T19:03:30.440ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:40792 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
21862024-08-27T19:03:30.440ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21872024-08-27T19:03:30.440ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
21882024-08-27T19:03:30.478ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21892024-08-27T19:03:30.479ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29e7c4ed-850a-4802-807a-976abd34163e", "content-length": "1", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
21902024-08-27T19:03:30.481ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21912024-08-27T19:03:30.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21922024-08-27T19:03:30.483ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.926143ms iteration = 3 status = null
21932024-08-27T19:03:30.567ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21942024-08-27T19:03:30.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
21952024-08-27T19:03:30.602ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21962024-08-27T19:03:30.602ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a5ac409-ed4c-45a9-9114-b1809cb0cba9", "content-length": "26", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
21972024-08-27T19:03:30.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21982024-08-27T19:03:30.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21992024-08-27T19:03:30.613ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22002024-08-27T19:03:30.613ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6a3c7f-3567-4f67-bb5f-1983676ec0e8", "content-length": "691", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22012024-08-27T19:03:30.613ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22022024-08-27T19:03:30.613ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22032024-08-27T19:03:30.613ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22042024-08-27T19:03:30.614ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 384.463087ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
22052024-08-27T19:03:30.615ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 385.365655ms iteration = 3 status = {}
22062024-08-27T19:03:30.616ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
22072024-08-27T19:03:30.616ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:41709
22082024-08-27T19:03:30.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41709 req_id = 53b5f00f-cedc-4b16-9e2d-3af95865cb0a roles = RoleSet { roles: {} } uri = /metrics/producers
22092024-08-27T19:03:30.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41709 req_id = 53b5f00f-cedc-4b16-9e2d-3af95865cb0a resource = Database result = Ok(()) uri = /metrics/producers
22102024-08-27T19:03:30.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22112024-08-27T19:03:30.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22122024-08-27T19:03:30.712ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "253b55bf-2dd2-43f7-a336-a78036ad57ee", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22132024-08-27T19:03:30.712ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22142024-08-27T19:03:30.713ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fb9f1f8e-d06f-4ec3-bb50-62e777087586", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22152024-08-27T19:03:30.713ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22162024-08-27T19:03:30.714ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22172024-08-27T19:03:30.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 310.870975ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22182024-08-27T19:03:30.735ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 505.315353ms iteration = 3 status = {}
22192024-08-27T19:03:30.746ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 4acc4057-9e37-454f-b1dd-7cbe37073be1
22202024-08-27T19:03:30.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41709 req_id = 53b5f00f-cedc-4b16-9e2d-3af95865cb0a roles = RoleSet { roles: {} } uri = /metrics/producers
22212024-08-27T19:03:30.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41709 req_id = 53b5f00f-cedc-4b16-9e2d-3af95865cb0a resource = Database result = Ok(()) uri = /metrics/producers
22222024-08-27T19:03:30.768ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22232024-08-27T19:03:30.777ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 uri = http://[fd00:1122:3344:101::d]:12223/producers
22242024-08-27T19:03:30.778ZDEBGnexus: client response oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60ec33e3-2b0d-48a9-97a1-35d23566ba77", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22252024-08-27T19:03:30.778ZINFOnexus: assigned collector to new producer collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 file = nexus/src/app/oximeter.rs:125 producer_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
22262024-08-27T19:03:30.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 162989 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41709 req_id = 53b5f00f-cedc-4b16-9e2d-3af95865cb0a response_code = 201 uri = /metrics/producers
22272024-08-27T19:03:30.779ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "53b5f00f-cedc-4b16-9e2d-3af95865cb0a", "content-length": "41", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22282024-08-27T19:03:30.781ZDEBGnexus (producer-registration-task): registered with nexus successfully
22292024-08-27T19:03:30.781ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
22302024-08-27T19:03:30.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5d53b9ee-16dc-4e48-b6b7-a2b7d677abac roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
22312024-08-27T19:03:30.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5d53b9ee-16dc-4e48-b6b7-a2b7d677abac resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
22322024-08-27T19:03:30.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5d53b9ee-16dc-4e48-b6b7-a2b7d677abac response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
22332024-08-27T19:03:30.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22342024-08-27T19:03:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22352024-08-27T19:03:30.812ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
22362024-08-27T19:03:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22372024-08-27T19:03:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22382024-08-27T19:03:30.819ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22392024-08-27T19:03:30.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b751d571-a4db-47c7-a36a-144bbff87125", "content-length": "121", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22402024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
22412024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
22422024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22432024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22442024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
22452024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
22462024-08-27T19:03:30.820ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
22472024-08-27T19:03:30.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22482024-08-27T19:03:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22492024-08-27T19:03:30.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22502024-08-27T19:03:30.822ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d1f68d15-48de-4d2f-8724-7502c66f2e33", "content-length": "2", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22512024-08-27T19:03:30.822ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22522024-08-27T19:03:30.822ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b9855b4c-7098-4d96-9140-a1cc259ae534", "content-length": "52", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22532024-08-27T19:03:30.822ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
22542024-08-27T19:03:30.822ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22552024-08-27T19:03:30.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22562024-08-27T19:03:30.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5bc81e79-48b9-434a-9255-b53917609894", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22572024-08-27T19:03:30.823ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22582024-08-27T19:03:30.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66a43f78-c7b6-41ce-ade3-04bfcea8453a", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22592024-08-27T19:03:30.824ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22602024-08-27T19:03:30.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2eb3196f-6f7c-4951-9773-114ebdf0cb44", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22612024-08-27T19:03:30.826ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22622024-08-27T19:03:30.828ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22632024-08-27T19:03:30.828ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 433.553578ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22642024-08-27T19:03:30.913ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b38f75a-cf78-4218-8f4a-82197a933c97", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22652024-08-27T19:03:30.913ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
22662024-08-27T19:03:30.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22672024-08-27T19:03:30.913ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fea8a205-a18c-4b14-992f-8dc6c0c74cd0", "content-length": "667", "date": "Tue, 27 Aug 2024 19:03:30 GMT"} })
22682024-08-27T19:03:30.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22692024-08-27T19:03:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22702024-08-27T19:03:30.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22712024-08-27T19:03:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22722024-08-27T19:03:30.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22732024-08-27T19:03:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22742024-08-27T19:03:30.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22752024-08-27T19:03:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22762024-08-27T19:03:30.926ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.469715ms iteration = 3 status = {}
22772024-08-27T19:03:31.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db0e295c-7646-4f44-84f2-09f717406601 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22782024-08-27T19:03:31.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db0e295c-7646-4f44-84f2-09f717406601 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22792024-08-27T19:03:31.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db0e295c-7646-4f44-84f2-09f717406601 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22802024-08-27T19:03:32.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac569244-1138-430e-9b7e-f980e206c86b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22812024-08-27T19:03:32.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac569244-1138-430e-9b7e-f980e206c86b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22822024-08-27T19:03:32.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ac569244-1138-430e-9b7e-f980e206c86b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22832024-08-27T19:03:33.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80ac6f78-8b1d-4872-ba44-8c0f89f0ce9e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22842024-08-27T19:03:33.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80ac6f78-8b1d-4872-ba44-8c0f89f0ce9e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22852024-08-27T19:03:33.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80ac6f78-8b1d-4872-ba44-8c0f89f0ce9e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22862024-08-27T19:03:34.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 284a902b-aaad-4475-9727-62b32190619d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22872024-08-27T19:03:34.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 284a902b-aaad-4475-9727-62b32190619d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22882024-08-27T19:03:34.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 284a902b-aaad-4475-9727-62b32190619d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22892024-08-27T19:03:35.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49ae7a60-00ec-46f9-9876-c8e313016faa roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22902024-08-27T19:03:35.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49ae7a60-00ec-46f9-9876-c8e313016faa resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22912024-08-27T19:03:35.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49ae7a60-00ec-46f9-9876-c8e313016faa response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22922024-08-27T19:03:36.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af2e79d5-5a14-4a58-aa9e-96362a16ebb9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22932024-08-27T19:03:36.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af2e79d5-5a14-4a58-aa9e-96362a16ebb9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22942024-08-27T19:03:36.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af2e79d5-5a14-4a58-aa9e-96362a16ebb9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22952024-08-27T19:03:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59261a9a-1517-47f1-bfc6-24dc4426d816 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22962024-08-27T19:03:37.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59261a9a-1517-47f1-bfc6-24dc4426d816 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22972024-08-27T19:03:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59261a9a-1517-47f1-bfc6-24dc4426d816 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22982024-08-27T19:03:38.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 210a98cc-3ef7-40d4-a904-2dfcec9af82d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
22992024-08-27T19:03:38.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 210a98cc-3ef7-40d4-a904-2dfcec9af82d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23002024-08-27T19:03:38.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 210a98cc-3ef7-40d4-a904-2dfcec9af82d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23012024-08-27T19:03:39.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 241885ed-057f-410d-bc02-3b66c8beea97 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23022024-08-27T19:03:39.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 241885ed-057f-410d-bc02-3b66c8beea97 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23032024-08-27T19:03:39.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 241885ed-057f-410d-bc02-3b66c8beea97 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23042024-08-27T19:03:40.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
23052024-08-27T19:03:40.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23062024-08-27T19:03:40.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
23072024-08-27T19:03:40.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082024-08-27T19:03:40.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23092024-08-27T19:03:40.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23102024-08-27T19:03:40.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23112024-08-27T19:03:40.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23122024-08-27T19:03:40.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23132024-08-27T19:03:40.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.43511ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142024-08-27T19:03:40.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23152024-08-27T19:03:40.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23162024-08-27T19:03:40.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23172024-08-27T19:03:40.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23182024-08-27T19:03:40.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23192024-08-27T19:03:40.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-08-27T19:03:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
23212024-08-27T19:03:40.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23222024-08-27T19:03:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23232024-08-27T19:03:40.243ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
23242024-08-27T19:03:40.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.607248ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
23252024-08-27T19:03:40.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa1aff78-17d2-43f9-b1b9-6fb73b56d9e3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23262024-08-27T19:03:40.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa1aff78-17d2-43f9-b1b9-6fb73b56d9e3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23272024-08-27T19:03:40.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa1aff78-17d2-43f9-b1b9-6fb73b56d9e3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23282024-08-27T19:03:40.812ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:40792 remote_addr = [fd00:1122:3344:101::d]:33073
23292024-08-27T19:03:40.815ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 1601c0d4-df39-442e-a96b-208fca9fcfd0 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
23302024-08-27T19:03:41.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee4e02d6-cb57-490e-be3c-0e3c010f2078 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23312024-08-27T19:03:41.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee4e02d6-cb57-490e-be3c-0e3c010f2078 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23322024-08-27T19:03:41.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee4e02d6-cb57-490e-be3c-0e3c010f2078 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23332024-08-27T19:03:42.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcbb55da-206f-4318-aa3d-190a05e6d882 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23342024-08-27T19:03:42.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcbb55da-206f-4318-aa3d-190a05e6d882 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23352024-08-27T19:03:42.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcbb55da-206f-4318-aa3d-190a05e6d882 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23362024-08-27T19:03:43.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5338bb7-cae9-4746-b4e8-7395ebb6cdb8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23372024-08-27T19:03:43.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5338bb7-cae9-4746-b4e8-7395ebb6cdb8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23382024-08-27T19:03:43.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5338bb7-cae9-4746-b4e8-7395ebb6cdb8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23392024-08-27T19:03:44.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96a3e16a-1c3c-4c35-a372-4e5d7de1dfd9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23402024-08-27T19:03:44.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96a3e16a-1c3c-4c35-a372-4e5d7de1dfd9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23412024-08-27T19:03:44.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96a3e16a-1c3c-4c35-a372-4e5d7de1dfd9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23422024-08-27T19:03:45.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 085afe23-9c76-4ed2-b397-293470b92250 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23432024-08-27T19:03:45.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 085afe23-9c76-4ed2-b397-293470b92250 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23442024-08-27T19:03:45.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 085afe23-9c76-4ed2-b397-293470b92250 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23452024-08-27T19:03:46.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfbff32a-eac9-4cc3-849e-d44c76100e2e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23462024-08-27T19:03:46.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfbff32a-eac9-4cc3-849e-d44c76100e2e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23472024-08-27T19:03:46.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfbff32a-eac9-4cc3-849e-d44c76100e2e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23482024-08-27T19:03:47.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a930a14-e6d8-4bd0-a73f-11df21afa0be roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23492024-08-27T19:03:47.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a930a14-e6d8-4bd0-a73f-11df21afa0be resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23502024-08-27T19:03:47.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a930a14-e6d8-4bd0-a73f-11df21afa0be response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23512024-08-27T19:03:48.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f19bb25a-a08c-4f62-ad6f-87291004bc86 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23522024-08-27T19:03:48.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f19bb25a-a08c-4f62-ad6f-87291004bc86 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23532024-08-27T19:03:48.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f19bb25a-a08c-4f62-ad6f-87291004bc86 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23542024-08-27T19:03:49.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 38864236-ed98-45d4-bee0-1be8185505d2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23552024-08-27T19:03:49.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 38864236-ed98-45d4-bee0-1be8185505d2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23562024-08-27T19:03:49.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 38864236-ed98-45d4-bee0-1be8185505d2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23572024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
23582024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23592024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
23602024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23612024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23622024-08-27T19:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23632024-08-27T19:03:50.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642024-08-27T19:03:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23652024-08-27T19:03:50.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23662024-08-27T19:03:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23672024-08-27T19:03:50.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23682024-08-27T19:03:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23692024-08-27T19:03:50.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702024-08-27T19:03:50.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
23712024-08-27T19:03:50.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23722024-08-27T19:03:50.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23732024-08-27T19:03:50.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
23742024-08-27T19:03:50.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.603688ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
23752024-08-27T19:03:50.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23762024-08-27T19:03:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23772024-08-27T19:03:50.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.593833ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23782024-08-27T19:03:50.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 261d754c-1e2a-4e6e-be61-8d12d8d73f34 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23792024-08-27T19:03:50.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 261d754c-1e2a-4e6e-be61-8d12d8d73f34 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23802024-08-27T19:03:50.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 261d754c-1e2a-4e6e-be61-8d12d8d73f34 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23812024-08-27T19:03:50.812ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 586 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = b5dc2f20-7576-4b50-88d2-7eae0b7a5051 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
23822024-08-27T19:03:51.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47d98f64-020b-4326-b782-75b05424003b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23832024-08-27T19:03:51.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47d98f64-020b-4326-b782-75b05424003b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23842024-08-27T19:03:51.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47d98f64-020b-4326-b782-75b05424003b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23852024-08-27T19:03:52.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b592cf6-90ad-4278-8b74-aec6718e0759 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23862024-08-27T19:03:52.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b592cf6-90ad-4278-8b74-aec6718e0759 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23872024-08-27T19:03:52.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b592cf6-90ad-4278-8b74-aec6718e0759 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23882024-08-27T19:03:53.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0331f401-f540-4dde-8a20-70a35ec65e0f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23892024-08-27T19:03:53.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0331f401-f540-4dde-8a20-70a35ec65e0f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23902024-08-27T19:03:53.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0331f401-f540-4dde-8a20-70a35ec65e0f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23912024-08-27T19:03:54.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4e9493c-1a24-4479-bda6-578df37238e5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23922024-08-27T19:03:54.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4e9493c-1a24-4479-bda6-578df37238e5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23932024-08-27T19:03:54.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4e9493c-1a24-4479-bda6-578df37238e5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23942024-08-27T19:03:55.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27ee2444-cbc5-45a0-825f-324f0964ff83 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23952024-08-27T19:03:55.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27ee2444-cbc5-45a0-825f-324f0964ff83 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23962024-08-27T19:03:55.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27ee2444-cbc5-45a0-825f-324f0964ff83 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23972024-08-27T19:03:56.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ff391a-ee95-4f3b-bd79-423bc0609a2a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23982024-08-27T19:03:56.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ff391a-ee95-4f3b-bd79-423bc0609a2a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
23992024-08-27T19:03:56.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ff391a-ee95-4f3b-bd79-423bc0609a2a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24002024-08-27T19:03:57.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 40022cd3-cb58-446b-b250-eef6088314b5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24012024-08-27T19:03:57.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 40022cd3-cb58-446b-b250-eef6088314b5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24022024-08-27T19:03:57.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 40022cd3-cb58-446b-b250-eef6088314b5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24032024-08-27T19:03:58.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d65445c6-edaf-4959-bd81-ceb51e28fa8b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24042024-08-27T19:03:58.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d65445c6-edaf-4959-bd81-ceb51e28fa8b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24052024-08-27T19:03:58.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d65445c6-edaf-4959-bd81-ceb51e28fa8b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24062024-08-27T19:03:59.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 10528232-2e0a-4df7-ada4-c12d357f7029 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24072024-08-27T19:03:59.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 10528232-2e0a-4df7-ada4-c12d357f7029 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24082024-08-27T19:03:59.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 10528232-2e0a-4df7-ada4-c12d357f7029 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
24092024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
24102024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
24112024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24122024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24132024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24142024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
24152024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
24162024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24172024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
24182024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24192024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
24202024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
24212024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24222024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
24232024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24242024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24252024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
24262024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24272024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
24282024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24292024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
24302024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24312024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
24322024-08-27T19:04:00.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24332024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24342024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24352024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24362024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24372024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24382024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24392024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24402024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24412024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24422024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24432024-08-27T19:04:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24442024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
24462024-08-27T19:04:00.231ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
24472024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24482024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
24492024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24502024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
24512024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
24522024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24532024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24542024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24552024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24562024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24572024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24582024-08-27T19:04:00.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592024-08-27T19:04:00.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602024-08-27T19:04:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.403109ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
24612024-08-27T19:04:00.232ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 886073246 } })
24622024-08-27T19:04:00.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 886326111 } })
24632024-08-27T19:04:00.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-08-27T19:04:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24652024-08-27T19:04:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24662024-08-27T19:04:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24672024-08-27T19:04:00.233ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.121225ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24682024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24692024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24702024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24712024-08-27T19:04:00.234ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
24722024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.726147ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24732024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24742024-08-27T19:04:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24752024-08-27T19:04:00.234ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
24762024-08-27T19:04:00.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.601494ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
24772024-08-27T19:04:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24782024-08-27T19:04:00.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24792024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24802024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24812024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24822024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24832024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24842024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24852024-08-27T19:04:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24862024-08-27T19:04:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24872024-08-27T19:04:00.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24882024-08-27T19:04:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24892024-08-27T19:04:00.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24902024-08-27T19:04:00.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24912024-08-27T19:04:00.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24922024-08-27T19:04:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24932024-08-27T19:04:00.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 900110173 } })
24942024-08-27T19:04:00.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24952024-08-27T19:04:00.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
24962024-08-27T19:04:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24972024-08-27T19:04:00.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24982024-08-27T19:04:00.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24992024-08-27T19:04:00.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25002024-08-27T19:04:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25012024-08-27T19:04:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25022024-08-27T19:04:00.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25032024-08-27T19:04:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25042024-08-27T19:04:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25052024-08-27T19:04:00.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25062024-08-27T19:04:00.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25072024-08-27T19:04:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25082024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25092024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
25102024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25112024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25122024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25132024-08-27T19:04:00.252ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25142024-08-27T19:04:00.252ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.03564ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25152024-08-27T19:04:00.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162024-08-27T19:04:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25172024-08-27T19:04:00.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25182024-08-27T19:04:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25192024-08-27T19:04:00.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
25202024-08-27T19:04:00.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.702725ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
25212024-08-27T19:04:00.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25222024-08-27T19:04:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25232024-08-27T19:04:00.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25242024-08-27T19:04:00.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25252024-08-27T19:04:00.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262024-08-27T19:04:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
25272024-08-27T19:04:00.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25282024-08-27T19:04:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25292024-08-27T19:04:00.271ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.921386ms iteration = 4 status = 0
25302024-08-27T19:04:00.272ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
25312024-08-27T19:04:00.272ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25322024-08-27T19:04:00.272ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25332024-08-27T19:04:00.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25342024-08-27T19:04:00.274ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25352024-08-27T19:04:00.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25362024-08-27T19:04:00.281ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
25372024-08-27T19:04:00.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.091872ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25382024-08-27T19:04:00.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25392024-08-27T19:04:00.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25402024-08-27T19:04:00.296ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.255113ms iteration = 6 status = {"physical_disks_added":0}
25412024-08-27T19:04:00.308ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
25422024-08-27T19:04:00.308ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25432024-08-27T19:04:00.308ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 78.91636ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
25442024-08-27T19:04:00.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.193577ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25452024-08-27T19:04:00.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
25462024-08-27T19:04:00.337ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25472024-08-27T19:04:00.338ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ebce7f80-3831-461d-90d6-4435e91dc998", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25482024-08-27T19:04:00.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25492024-08-27T19:04:00.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25502024-08-27T19:04:00.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
25512024-08-27T19:04:00.348ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25522024-08-27T19:04:00.349ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22f5a0e1-fde8-40ae-9482-65e70a9aa1b4", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25532024-08-27T19:04:00.349ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25542024-08-27T19:04:00.351ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25552024-08-27T19:04:00.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
25562024-08-27T19:04:00.357ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25572024-08-27T19:04:00.357ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7771ed4f-2d24-4fbe-be31-a026e4ce409a", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25582024-08-27T19:04:00.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25592024-08-27T19:04:00.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
25602024-08-27T19:04:00.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25612024-08-27T19:04:00.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25622024-08-27T19:04:00.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632024-08-27T19:04:00.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25642024-08-27T19:04:00.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25652024-08-27T19:04:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25662024-08-27T19:04:00.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25672024-08-27T19:04:00.380ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25682024-08-27T19:04:00.381ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "003a9ea1-e88b-4d19-a913-f0fd79f9ec8f", "content-length": "372", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25692024-08-27T19:04:00.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25702024-08-27T19:04:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25712024-08-27T19:04:00.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25722024-08-27T19:04:00.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25732024-08-27T19:04:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25742024-08-27T19:04:00.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25752024-08-27T19:04:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25762024-08-27T19:04:00.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25772024-08-27T19:04:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782024-08-27T19:04:00.388ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25792024-08-27T19:04:00.389ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "90b70cf4-ec0c-4dab-a24f-6dda90356b42", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25802024-08-27T19:04:00.391ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.939834ms iteration = 4 status = {}
25812024-08-27T19:04:00.454ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.261697ms iteration = 4 status = {}
25822024-08-27T19:04:00.459ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25832024-08-27T19:04:00.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c701f051-e6eb-4eb2-9ba4-794a527cbe6d", "content-length": "1", "date": "Tue, 27 Aug 2024 19:03:59 GMT"} })
25842024-08-27T19:04:00.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25852024-08-27T19:04:00.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25862024-08-27T19:04:00.463ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.950725ms iteration = 4 status = null
25872024-08-27T19:04:00.484ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25882024-08-27T19:04:00.484ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfa37974-a964-4aa2-8c08-db9ec2a7723f", "content-length": "691", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
25892024-08-27T19:04:00.484ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25902024-08-27T19:04:00.484ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25912024-08-27T19:04:00.484ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25922024-08-27T19:04:00.486ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.115757ms iteration = 4 status = {}
25932024-08-27T19:04:00.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25942024-08-27T19:04:00.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25952024-08-27T19:04:00.541ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
25962024-08-27T19:04:00.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972024-08-27T19:04:00.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982024-08-27T19:04:00.548ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25992024-08-27T19:04:00.548ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86498cc1-8f98-470c-8f2a-489e4607b296", "content-length": "121", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
26002024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
26012024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
26022024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26032024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26042024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
26052024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
26062024-08-27T19:04:00.548ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
26072024-08-27T19:04:00.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26082024-08-27T19:04:00.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26092024-08-27T19:04:00.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26102024-08-27T19:04:00.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e6e27d3-ecc2-427c-b571-e5f2bd461882", "content-length": "2", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
26112024-08-27T19:04:00.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26122024-08-27T19:04:00.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c5acf15-2eed-4656-8a7a-bfe68332bd4a", "content-length": "52", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
26132024-08-27T19:04:00.550ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
26142024-08-27T19:04:00.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26152024-08-27T19:04:00.647ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6a7facc3-879f-49f9-bf99-b33e43d2f098", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
26162024-08-27T19:04:00.647ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
26172024-08-27T19:04:00.647ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26182024-08-27T19:04:00.651ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e29ce54-d14d-467b-a023-fe7e68886af9", "content-length": "667", "date": "Tue, 27 Aug 2024 19:04:00 GMT"} })
26192024-08-27T19:04:00.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26202024-08-27T19:04:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26212024-08-27T19:04:00.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26222024-08-27T19:04:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26232024-08-27T19:04:00.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26242024-08-27T19:04:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26252024-08-27T19:04:00.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26262024-08-27T19:04:00.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26272024-08-27T19:04:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 436.483089ms iteration = 4 status = {}
26282024-08-27T19:04:00.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96ae2850-4194-4bb5-99ab-5b9225dc1f3d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26292024-08-27T19:04:00.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96ae2850-4194-4bb5-99ab-5b9225dc1f3d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26302024-08-27T19:04:00.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 96ae2850-4194-4bb5-99ab-5b9225dc1f3d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26312024-08-27T19:04:00.812ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 464 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = e4fede4c-5008-44bb-9258-fad38d12fac3 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
26322024-08-27T19:04:00.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 62a5a096-02af-4838-a634-3c45c0b0d927 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
26332024-08-27T19:04:00.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 62a5a096-02af-4838-a634-3c45c0b0d927 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
26342024-08-27T19:04:00.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 62a5a096-02af-4838-a634-3c45c0b0d927 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
26352024-08-27T19:04:01.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ca94b09-ca4b-4ed0-9743-02a816b87601 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26362024-08-27T19:04:01.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ca94b09-ca4b-4ed0-9743-02a816b87601 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26372024-08-27T19:04:01.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ca94b09-ca4b-4ed0-9743-02a816b87601 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26382024-08-27T19:04:02.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cc07b78-6944-41d8-a249-d771a28c878b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26392024-08-27T19:04:02.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cc07b78-6944-41d8-a249-d771a28c878b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26402024-08-27T19:04:02.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cc07b78-6944-41d8-a249-d771a28c878b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26412024-08-27T19:04:03.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6941bd03-4747-42f9-aa0e-d874aae242b5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26422024-08-27T19:04:03.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6941bd03-4747-42f9-aa0e-d874aae242b5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26432024-08-27T19:04:03.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6941bd03-4747-42f9-aa0e-d874aae242b5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26442024-08-27T19:04:04.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaa7e60a-fdab-41ab-93a1-073e949ed29c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26452024-08-27T19:04:04.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaa7e60a-fdab-41ab-93a1-073e949ed29c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26462024-08-27T19:04:04.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaa7e60a-fdab-41ab-93a1-073e949ed29c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26472024-08-27T19:04:05.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b2025a87-d864-4df0-9c53-74bfbc007d1a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26482024-08-27T19:04:05.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b2025a87-d864-4df0-9c53-74bfbc007d1a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26492024-08-27T19:04:05.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b2025a87-d864-4df0-9c53-74bfbc007d1a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26502024-08-27T19:04:06.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbe50d5e-c46e-4e33-901d-997c316484eb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26512024-08-27T19:04:06.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbe50d5e-c46e-4e33-901d-997c316484eb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26522024-08-27T19:04:06.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbe50d5e-c46e-4e33-901d-997c316484eb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26532024-08-27T19:04:07.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0ecaf3dc-140e-4cc0-b045-877477e2e93d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26542024-08-27T19:04:07.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0ecaf3dc-140e-4cc0-b045-877477e2e93d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26552024-08-27T19:04:07.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0ecaf3dc-140e-4cc0-b045-877477e2e93d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26562024-08-27T19:04:08.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8234344f-d203-4947-a46f-1aa260e872c3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26572024-08-27T19:04:08.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8234344f-d203-4947-a46f-1aa260e872c3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26582024-08-27T19:04:08.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8234344f-d203-4947-a46f-1aa260e872c3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26592024-08-27T19:04:09.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f49a2a84-cc37-46e7-859c-d981e85056d8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26602024-08-27T19:04:09.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f49a2a84-cc37-46e7-859c-d981e85056d8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26612024-08-27T19:04:09.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f49a2a84-cc37-46e7-859c-d981e85056d8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26622024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
26632024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
26642024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26652024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26662024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26672024-08-27T19:04:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26682024-08-27T19:04:10.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-08-27T19:04:10.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26702024-08-27T19:04:10.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26712024-08-27T19:04:10.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.606373ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26722024-08-27T19:04:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26732024-08-27T19:04:10.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26742024-08-27T19:04:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26752024-08-27T19:04:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26762024-08-27T19:04:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26772024-08-27T19:04:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26782024-08-27T19:04:10.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
26792024-08-27T19:04:10.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26802024-08-27T19:04:10.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26812024-08-27T19:04:10.243ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
26822024-08-27T19:04:10.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.490005ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
26832024-08-27T19:04:10.813ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 1bd36e35-6f4d-4656-93ed-2e3e0c322fbc response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
26842024-08-27T19:04:10.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d110ed79-6309-4c6d-9322-3065a7105ebd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26852024-08-27T19:04:10.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d110ed79-6309-4c6d-9322-3065a7105ebd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26862024-08-27T19:04:10.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d110ed79-6309-4c6d-9322-3065a7105ebd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26872024-08-27T19:04:12.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 644c61f6-0483-427d-a062-eb32a3c7e435 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26882024-08-27T19:04:12.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 644c61f6-0483-427d-a062-eb32a3c7e435 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26892024-08-27T19:04:12.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 644c61f6-0483-427d-a062-eb32a3c7e435 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26902024-08-27T19:04:13.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47e686e5-1034-456a-8164-e48d7b636645 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26912024-08-27T19:04:13.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47e686e5-1034-456a-8164-e48d7b636645 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26922024-08-27T19:04:13.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47e686e5-1034-456a-8164-e48d7b636645 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26932024-08-27T19:04:14.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59a0af37-6cd4-4337-a25c-2ef811da5b3f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26942024-08-27T19:04:14.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59a0af37-6cd4-4337-a25c-2ef811da5b3f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26952024-08-27T19:04:14.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 59a0af37-6cd4-4337-a25c-2ef811da5b3f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26962024-08-27T19:04:15.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5dbd16b-d11f-4059-9ecc-77bab88426fe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26972024-08-27T19:04:15.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5dbd16b-d11f-4059-9ecc-77bab88426fe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26982024-08-27T19:04:15.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5dbd16b-d11f-4059-9ecc-77bab88426fe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
26992024-08-27T19:04:16.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abc9132b-d313-4741-890f-84678cfea0e4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27002024-08-27T19:04:16.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abc9132b-d313-4741-890f-84678cfea0e4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27012024-08-27T19:04:16.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abc9132b-d313-4741-890f-84678cfea0e4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27022024-08-27T19:04:17.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 422a7f43-afef-4656-b81b-0dfff4e5815b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27032024-08-27T19:04:17.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 422a7f43-afef-4656-b81b-0dfff4e5815b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27042024-08-27T19:04:17.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 422a7f43-afef-4656-b81b-0dfff4e5815b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27052024-08-27T19:04:18.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 947a96d0-f5eb-4b00-bf2a-d4343aadf17c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27062024-08-27T19:04:18.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 947a96d0-f5eb-4b00-bf2a-d4343aadf17c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27072024-08-27T19:04:18.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 947a96d0-f5eb-4b00-bf2a-d4343aadf17c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27082024-08-27T19:04:19.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aed4accb-39f1-4a0a-950b-c3fa664dfcb2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27092024-08-27T19:04:19.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aed4accb-39f1-4a0a-950b-c3fa664dfcb2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27102024-08-27T19:04:19.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aed4accb-39f1-4a0a-950b-c3fa664dfcb2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27112024-08-27T19:04:20.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 175f12f7-7553-43b0-a685-4e0d2ee128f0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27122024-08-27T19:04:20.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 175f12f7-7553-43b0-a685-4e0d2ee128f0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27132024-08-27T19:04:20.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 175f12f7-7553-43b0-a685-4e0d2ee128f0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27142024-08-27T19:04:20.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
27152024-08-27T19:04:20.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27162024-08-27T19:04:20.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
27172024-08-27T19:04:20.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27182024-08-27T19:04:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27192024-08-27T19:04:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27202024-08-27T19:04:20.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27212024-08-27T19:04:20.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27222024-08-27T19:04:20.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27232024-08-27T19:04:20.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.48843ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27242024-08-27T19:04:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27252024-08-27T19:04:20.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27262024-08-27T19:04:20.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27272024-08-27T19:04:20.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27282024-08-27T19:04:20.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27292024-08-27T19:04:20.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-08-27T19:04:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
27312024-08-27T19:04:20.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27322024-08-27T19:04:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27332024-08-27T19:04:20.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
27342024-08-27T19:04:20.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.751741ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
27352024-08-27T19:04:20.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 995 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 84f69e1d-9eea-47ff-96e0-0aefcec08595 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
27362024-08-27T19:04:21.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5059ff5a-0cce-4044-b5c9-e1591a802a3f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27372024-08-27T19:04:21.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5059ff5a-0cce-4044-b5c9-e1591a802a3f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27382024-08-27T19:04:21.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5059ff5a-0cce-4044-b5c9-e1591a802a3f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27392024-08-27T19:04:22.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83701bb9-8414-4f61-8372-dc74388dbaba roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27402024-08-27T19:04:22.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83701bb9-8414-4f61-8372-dc74388dbaba resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27412024-08-27T19:04:22.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 83701bb9-8414-4f61-8372-dc74388dbaba response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27422024-08-27T19:04:23.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a67c1dad-f081-4c1a-b935-665851f41032 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27432024-08-27T19:04:23.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a67c1dad-f081-4c1a-b935-665851f41032 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27442024-08-27T19:04:23.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a67c1dad-f081-4c1a-b935-665851f41032 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27452024-08-27T19:04:24.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8d6a0cec-4169-400e-be8d-95c74c4d09d8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27462024-08-27T19:04:24.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8d6a0cec-4169-400e-be8d-95c74c4d09d8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27472024-08-27T19:04:24.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8d6a0cec-4169-400e-be8d-95c74c4d09d8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27482024-08-27T19:04:25.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f3bd2e4-b0af-4551-b8a9-c863d1168e25 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27492024-08-27T19:04:25.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f3bd2e4-b0af-4551-b8a9-c863d1168e25 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27502024-08-27T19:04:25.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1f3bd2e4-b0af-4551-b8a9-c863d1168e25 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27512024-08-27T19:04:26.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc67c84f-764e-4202-932d-308c4362d9c1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27522024-08-27T19:04:26.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc67c84f-764e-4202-932d-308c4362d9c1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27532024-08-27T19:04:26.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc67c84f-764e-4202-932d-308c4362d9c1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27542024-08-27T19:04:27.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 63e12968-f590-467b-aa93-91c9800556a0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27552024-08-27T19:04:27.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 63e12968-f590-467b-aa93-91c9800556a0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27562024-08-27T19:04:27.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 63e12968-f590-467b-aa93-91c9800556a0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27572024-08-27T19:04:28.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28ec57e9-2d9d-4e1d-949b-42deabfa9614 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27582024-08-27T19:04:28.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28ec57e9-2d9d-4e1d-949b-42deabfa9614 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27592024-08-27T19:04:28.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28ec57e9-2d9d-4e1d-949b-42deabfa9614 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27602024-08-27T19:04:29.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0814ced3-7f23-435c-8e8b-0cc10097b23d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27612024-08-27T19:04:29.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0814ced3-7f23-435c-8e8b-0cc10097b23d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27622024-08-27T19:04:29.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0814ced3-7f23-435c-8e8b-0cc10097b23d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
27632024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
27642024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
27652024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
27672024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
27682024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27692024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
27702024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
27712024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27722024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
27732024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
27742024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27752024-08-27T19:04:30.245ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
27762024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27772024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
27782024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27792024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
27802024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
27812024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27822024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27832024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27842024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
27852024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
27862024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
27872024-08-27T19:04:30.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
27882024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27892024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.79\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
27902024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
27912024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
27922024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27932024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
27942024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27952024-08-27T19:04:30.245ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:54:30.245528378 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27962024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
27972024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27982024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27992024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
28002024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
28012024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28022024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
28032024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
28042024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
28052024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28062024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28072024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
28082024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
28092024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
28102024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28112024-08-27T19:04:30.245ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
28122024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28132024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
28142024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
28152024-08-27T19:04:30.245ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
28162024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28172024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28182024-08-27T19:04:30.245ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
28192024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28202024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
28212024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28222024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28232024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28242024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28252024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28262024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28282024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28292024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28302024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28312024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28322024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28332024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28342024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28352024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28362024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28372024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28382024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
28392024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28402024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28412024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28422024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
28432024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28442024-08-27T19:04:30.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28452024-08-27T19:04:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28462024-08-27T19:04:30.247ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 885662120 } })
28472024-08-27T19:04:30.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28482024-08-27T19:04:30.247ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 885879934 } })
28492024-08-27T19:04:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28502024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.808638ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28512024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28522024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28532024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28542024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552024-08-27T19:04:30.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28572024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
28592024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.005552ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
28602024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
28612024-08-27T19:04:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.944281ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
28622024-08-27T19:04:30.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.692256ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28632024-08-27T19:04:30.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28642024-08-27T19:04:30.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28652024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28662024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28672024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28682024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28692024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28702024-08-27T19:04:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28712024-08-27T19:04:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
28722024-08-27T19:04:30.255ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28732024-08-27T19:04:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28742024-08-27T19:04:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28752024-08-27T19:04:30.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28762024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28772024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28782024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28792024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28802024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28812024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28822024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28832024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28842024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28852024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28862024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872024-08-27T19:04:30.256ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:54:30.245528378 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
28882024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.242729ms iteration = 3 status = {"expiration":"2024-08-27T18:54:30.245528378Z","pruned":[]}
28892024-08-27T19:04:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28902024-08-27T19:04:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28912024-08-27T19:04:30.257ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 896047652 } })
28922024-08-27T19:04:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932024-08-27T19:04:30.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
28942024-08-27T19:04:30.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28952024-08-27T19:04:30.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28962024-08-27T19:04:30.258ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28972024-08-27T19:04:30.258ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28982024-08-27T19:04:30.258ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 12.962284ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28992024-08-27T19:04:30.259ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29002024-08-27T19:04:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29012024-08-27T19:04:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29022024-08-27T19:04:30.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29032024-08-27T19:04:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29042024-08-27T19:04:30.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29052024-08-27T19:04:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29062024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.349743ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29072024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29082024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29092024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29102024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29112024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29122024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29132024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29142024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29152024-08-27T19:04:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.15148ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
29162024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29172024-08-27T19:04:30.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 900625525 } })
29182024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29192024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29202024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
29212024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
29222024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
29232024-08-27T19:04:30.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29242024-08-27T19:04:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29252024-08-27T19:04:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29262024-08-27T19:04:30.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
29272024-08-27T19:04:30.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 902227758 } })
29282024-08-27T19:04:30.265ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29292024-08-27T19:04:30.265ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
29302024-08-27T19:04:30.265ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
29312024-08-27T19:04:30.265ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.136702ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
29322024-08-27T19:04:30.266ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29332024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.461668ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29342024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29352024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29362024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29372024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29382024-08-27T19:04:30.266ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
29392024-08-27T19:04:30.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-08-27T19:04:30.267ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
29412024-08-27T19:04:30.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 21.430607ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29422024-08-27T19:04:30.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29432024-08-27T19:04:30.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29442024-08-27T19:04:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29452024-08-27T19:04:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29462024-08-27T19:04:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29472024-08-27T19:04:30.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29482024-08-27T19:04:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29492024-08-27T19:04:30.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-08-27T19:04:30.273ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.147014ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
29512024-08-27T19:04:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
29522024-08-27T19:04:30.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29532024-08-27T19:04:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29542024-08-27T19:04:30.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29552024-08-27T19:04:30.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29562024-08-27T19:04:30.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29572024-08-27T19:04:30.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29582024-08-27T19:04:30.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29592024-08-27T19:04:30.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29602024-08-27T19:04:30.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29612024-08-27T19:04:30.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29622024-08-27T19:04:30.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
29632024-08-27T19:04:30.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.151351ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
29642024-08-27T19:04:30.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29652024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29662024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29672024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29682024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
29692024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
29702024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29712024-08-27T19:04:30.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29722024-08-27T19:04:30.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29732024-08-27T19:04:30.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742024-08-27T19:04:30.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29752024-08-27T19:04:30.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29762024-08-27T19:04:30.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29772024-08-27T19:04:30.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29782024-08-27T19:04:30.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29792024-08-27T19:04:30.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29802024-08-27T19:04:30.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29812024-08-27T19:04:30.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29822024-08-27T19:04:30.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29832024-08-27T19:04:30.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29842024-08-27T19:04:30.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-08-27T19:04:30.302ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
29862024-08-27T19:04:30.302ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
29872024-08-27T19:04:30.302ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
29882024-08-27T19:04:30.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 56.879861ms iteration = 3 status = {"generation":1}
29892024-08-27T19:04:30.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29902024-08-27T19:04:30.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29912024-08-27T19:04:30.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
29922024-08-27T19:04:30.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29932024-08-27T19:04:30.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29942024-08-27T19:04:30.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.717868ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
29952024-08-27T19:04:30.316ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
29962024-08-27T19:04:30.316ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29972024-08-27T19:04:30.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29982024-08-27T19:04:30.316ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.920257ms iteration = 5 status = 0
29992024-08-27T19:04:30.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30002024-08-27T19:04:30.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.492955ms iteration = 7 status = {"physical_disks_added":0}
30012024-08-27T19:04:30.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
30022024-08-27T19:04:30.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30032024-08-27T19:04:30.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.673206ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
30042024-08-27T19:04:30.350ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
30052024-08-27T19:04:30.350ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 105.164327ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
30062024-08-27T19:04:30.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
30072024-08-27T19:04:30.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3648215a-d98b-48e7-9657-0e96996d38e5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
30082024-08-27T19:04:30.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3648215a-d98b-48e7-9657-0e96996d38e5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
30092024-08-27T19:04:30.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3648215a-d98b-48e7-9657-0e96996d38e5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
30102024-08-27T19:04:30.431ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
30112024-08-27T19:04:30.431ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30122024-08-27T19:04:30.432ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb74bb5-cefd-4c9c-9dee-5fed0a7ae68d", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30132024-08-27T19:04:30.432ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30142024-08-27T19:04:30.434ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30152024-08-27T19:04:30.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
30162024-08-27T19:04:30.453ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30172024-08-27T19:04:30.454ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad4a262b-fc00-45bd-a5fd-cb7f9f1a64bc", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30182024-08-27T19:04:30.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30192024-08-27T19:04:30.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
30202024-08-27T19:04:30.466ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
30212024-08-27T19:04:30.466ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30222024-08-27T19:04:30.468ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fb01045c-89f8-417a-aa74-aa584ded18f0", "content-length": "26", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30232024-08-27T19:04:30.468ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30242024-08-27T19:04:30.470ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30252024-08-27T19:04:30.530ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
30262024-08-27T19:04:30.568ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30272024-08-27T19:04:30.569ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd85c40a-ab34-48eb-bd34-2fb7ce52c7a2", "content-length": "691", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30282024-08-27T19:04:30.569ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30292024-08-27T19:04:30.569ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30302024-08-27T19:04:30.569ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30312024-08-27T19:04:30.571ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.895121ms iteration = 5 status = {}
30322024-08-27T19:04:30.605ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30332024-08-27T19:04:30.605ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99a6dc5e-8588-4539-880e-4309cac53538", "content-length": "372", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30342024-08-27T19:04:30.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30352024-08-27T19:04:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30362024-08-27T19:04:30.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372024-08-27T19:04:30.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30382024-08-27T19:04:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30392024-08-27T19:04:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30402024-08-27T19:04:30.609ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30412024-08-27T19:04:30.609ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30422024-08-27T19:04:30.609ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30432024-08-27T19:04:30.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30442024-08-27T19:04:30.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30452024-08-27T19:04:30.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30462024-08-27T19:04:30.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30472024-08-27T19:04:30.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30482024-08-27T19:04:30.613ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30492024-08-27T19:04:30.613ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "57cd07ec-dff3-4857-b8b4-f366ed9cad26", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
30502024-08-27T19:04:30.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30512024-08-27T19:04:30.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30522024-08-27T19:04:30.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30532024-08-27T19:04:30.615ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.154065ms iteration = 5 status = {}
30542024-08-27T19:04:30.627ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
30552024-08-27T19:04:30.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4b83203b-c171-434e-b383-52b8e98dd851", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30562024-08-27T19:04:30.628ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30572024-08-27T19:04:30.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2338b847-8768-4006-8634-5268d49b9ff4", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30582024-08-27T19:04:30.631ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30592024-08-27T19:04:30.632ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30602024-08-27T19:04:30.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.498548ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
30612024-08-27T19:04:30.643ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30622024-08-27T19:04:30.643ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
30632024-08-27T19:04:30.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30642024-08-27T19:04:30.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30652024-08-27T19:04:30.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30662024-08-27T19:04:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30672024-08-27T19:04:30.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30682024-08-27T19:04:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30692024-08-27T19:04:30.648ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30702024-08-27T19:04:30.649ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
30712024-08-27T19:04:30.649ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
30722024-08-27T19:04:30.649ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
30732024-08-27T19:04:30.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 404.018556ms iteration = 3 status = {"generation":2}
30742024-08-27T19:04:30.649ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9728d828-9c9c-433a-a9fb-d100eaf54a36", "content-length": "1", "date": "Tue, 27 Aug 2024 19:04:29 GMT"} })
30752024-08-27T19:04:30.652ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30762024-08-27T19:04:30.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30772024-08-27T19:04:30.654ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 408.474936ms iteration = 5 status = null
30782024-08-27T19:04:30.676ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 430.769722ms iteration = 5 status = {}
30792024-08-27T19:04:30.678ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30802024-08-27T19:04:30.737ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
30812024-08-27T19:04:30.737ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "58324f10-ec25-4fb9-a8a7-c7b1f245bfa4", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30822024-08-27T19:04:30.737ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30832024-08-27T19:04:30.738ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6cac44d0-20a6-4c84-88a7-655c1c900ea0", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30842024-08-27T19:04:30.739ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30852024-08-27T19:04:30.740ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f2829ec-e667-4131-bb80-50ef54faa25d", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30862024-08-27T19:04:30.740ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30872024-08-27T19:04:30.741ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
30882024-08-27T19:04:30.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 496.342911ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
30892024-08-27T19:04:30.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30902024-08-27T19:04:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30912024-08-27T19:04:30.748ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
30922024-08-27T19:04:30.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30932024-08-27T19:04:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30942024-08-27T19:04:30.756ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30952024-08-27T19:04:30.757ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "48ffb725-5820-4d54-87a4-78c058338703", "content-length": "121", "date": "Tue, 27 Aug 2024 19:04:29 GMT"} })
30962024-08-27T19:04:30.757ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
30972024-08-27T19:04:30.757ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
30982024-08-27T19:04:30.758ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30992024-08-27T19:04:30.758ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31002024-08-27T19:04:30.758ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
31012024-08-27T19:04:30.758ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
31022024-08-27T19:04:30.758ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
31032024-08-27T19:04:30.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31042024-08-27T19:04:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31052024-08-27T19:04:30.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31062024-08-27T19:04:30.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fdbcf500-bdb8-46b4-9690-04db54a18294", "content-length": "2", "date": "Tue, 27 Aug 2024 19:04:29 GMT"} })
31072024-08-27T19:04:30.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31082024-08-27T19:04:30.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d018f549-5c01-4e35-b9af-c992715d1ff8", "content-length": "52", "date": "Tue, 27 Aug 2024 19:04:29 GMT"} })
31092024-08-27T19:04:30.759ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
31102024-08-27T19:04:30.759ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31112024-08-27T19:04:30.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 461 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 30c343ff-d1bb-4a0e-ab10-e3d2213348d6 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
31122024-08-27T19:04:30.871ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e43a2b7b-06d9-4a4a-9bae-95944e627f57", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
31132024-08-27T19:04:30.871ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
31142024-08-27T19:04:30.871ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31152024-08-27T19:04:30.871ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e11ecdb4-3d7e-4bec-a6f3-1723b67a28b4", "content-length": "667", "date": "Tue, 27 Aug 2024 19:04:30 GMT"} })
31162024-08-27T19:04:30.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31172024-08-27T19:04:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31182024-08-27T19:04:30.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 99704438-c91c-45db-8aa9-ddbf4a625950 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
31192024-08-27T19:04:30.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 99704438-c91c-45db-8aa9-ddbf4a625950 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
31202024-08-27T19:04:30.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 99704438-c91c-45db-8aa9-ddbf4a625950 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
31212024-08-27T19:04:30.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31222024-08-27T19:04:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31232024-08-27T19:04:30.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31242024-08-27T19:04:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31252024-08-27T19:04:30.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31262024-08-27T19:04:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31272024-08-27T19:04:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.782958ms iteration = 5 status = {}
31282024-08-27T19:04:31.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6fac8b26-b14e-447a-a8d2-804bb77c45f0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31292024-08-27T19:04:31.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6fac8b26-b14e-447a-a8d2-804bb77c45f0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31302024-08-27T19:04:31.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6fac8b26-b14e-447a-a8d2-804bb77c45f0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31312024-08-27T19:04:32.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 403591ad-8681-48b2-ad9d-37e46dc73864 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31322024-08-27T19:04:32.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 403591ad-8681-48b2-ad9d-37e46dc73864 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31332024-08-27T19:04:32.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 403591ad-8681-48b2-ad9d-37e46dc73864 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31342024-08-27T19:04:33.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b57c75b-f349-4fe9-b9dd-7c59a13e0d7e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31352024-08-27T19:04:33.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b57c75b-f349-4fe9-b9dd-7c59a13e0d7e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31362024-08-27T19:04:33.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b57c75b-f349-4fe9-b9dd-7c59a13e0d7e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31372024-08-27T19:04:34.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc75324a-ba62-4b81-a8aa-3af61c542ba3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31382024-08-27T19:04:34.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc75324a-ba62-4b81-a8aa-3af61c542ba3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31392024-08-27T19:04:34.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc75324a-ba62-4b81-a8aa-3af61c542ba3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31402024-08-27T19:04:35.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5f5afe30-1989-4ade-b49d-c8868bf1b43c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31412024-08-27T19:04:35.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5f5afe30-1989-4ade-b49d-c8868bf1b43c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31422024-08-27T19:04:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5f5afe30-1989-4ade-b49d-c8868bf1b43c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31432024-08-27T19:04:36.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5dcb37da-a492-43e0-8efa-c4d4437a1ee9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31442024-08-27T19:04:36.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5dcb37da-a492-43e0-8efa-c4d4437a1ee9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31452024-08-27T19:04:36.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5dcb37da-a492-43e0-8efa-c4d4437a1ee9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31462024-08-27T19:04:37.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8066eb36-e0d3-4753-a65b-7a055a21617b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31472024-08-27T19:04:37.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8066eb36-e0d3-4753-a65b-7a055a21617b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31482024-08-27T19:04:37.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8066eb36-e0d3-4753-a65b-7a055a21617b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31492024-08-27T19:04:38.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dea4d9f-5bf9-4c8a-ab74-8ca036ddf579 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31502024-08-27T19:04:38.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dea4d9f-5bf9-4c8a-ab74-8ca036ddf579 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31512024-08-27T19:04:38.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dea4d9f-5bf9-4c8a-ab74-8ca036ddf579 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31522024-08-27T19:04:39.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cdfb1811-2bfa-432d-af88-b91cb3acef32 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31532024-08-27T19:04:39.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cdfb1811-2bfa-432d-af88-b91cb3acef32 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31542024-08-27T19:04:39.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cdfb1811-2bfa-432d-af88-b91cb3acef32 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31552024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
31562024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31572024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
31582024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31592024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31602024-08-27T19:04:40.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31612024-08-27T19:04:40.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31622024-08-27T19:04:40.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31632024-08-27T19:04:40.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31642024-08-27T19:04:40.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.661074ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31652024-08-27T19:04:40.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31662024-08-27T19:04:40.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31672024-08-27T19:04:40.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31682024-08-27T19:04:40.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31692024-08-27T19:04:40.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31702024-08-27T19:04:40.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31712024-08-27T19:04:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
31722024-08-27T19:04:40.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31732024-08-27T19:04:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31742024-08-27T19:04:40.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
31752024-08-27T19:04:40.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.239191ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
31762024-08-27T19:04:40.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2290f9c2-d3f9-476d-bb02-35af23294f73 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31772024-08-27T19:04:40.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2290f9c2-d3f9-476d-bb02-35af23294f73 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31782024-08-27T19:04:40.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2290f9c2-d3f9-476d-bb02-35af23294f73 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31792024-08-27T19:04:40.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1189 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = e54574ab-4092-4db2-988a-8188a9808099 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
31802024-08-27T19:04:41.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a27972db-a6d5-483f-9c42-11f32dcfa8bd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31812024-08-27T19:04:41.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a27972db-a6d5-483f-9c42-11f32dcfa8bd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31822024-08-27T19:04:41.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a27972db-a6d5-483f-9c42-11f32dcfa8bd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31832024-08-27T19:04:42.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e9d9594-607f-4e82-ba3e-8e3d93fef542 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31842024-08-27T19:04:42.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e9d9594-607f-4e82-ba3e-8e3d93fef542 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31852024-08-27T19:04:42.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e9d9594-607f-4e82-ba3e-8e3d93fef542 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31862024-08-27T19:04:43.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d401f9c7-86c4-4796-9371-04dcd03f317e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31872024-08-27T19:04:43.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d401f9c7-86c4-4796-9371-04dcd03f317e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31882024-08-27T19:04:43.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d401f9c7-86c4-4796-9371-04dcd03f317e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31892024-08-27T19:04:44.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4172c71-321f-455a-ae37-94fe6ab5009c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31902024-08-27T19:04:44.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4172c71-321f-455a-ae37-94fe6ab5009c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31912024-08-27T19:04:44.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e4172c71-321f-455a-ae37-94fe6ab5009c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31922024-08-27T19:04:45.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7004d469-13e1-4469-a6ff-bb085a252cae roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31932024-08-27T19:04:45.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7004d469-13e1-4469-a6ff-bb085a252cae resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31942024-08-27T19:04:45.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7004d469-13e1-4469-a6ff-bb085a252cae response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31952024-08-27T19:04:46.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a9081a43-a493-44da-bbb1-cbcd8a6862ff roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31962024-08-27T19:04:46.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a9081a43-a493-44da-bbb1-cbcd8a6862ff resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31972024-08-27T19:04:46.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a9081a43-a493-44da-bbb1-cbcd8a6862ff response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31982024-08-27T19:04:47.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a697eb-c031-4e56-b5c1-c4c93672292b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
31992024-08-27T19:04:47.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a697eb-c031-4e56-b5c1-c4c93672292b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32002024-08-27T19:04:47.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a697eb-c031-4e56-b5c1-c4c93672292b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32012024-08-27T19:04:48.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c9e8f11-4577-4e90-a938-f05d436b4059 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32022024-08-27T19:04:48.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c9e8f11-4577-4e90-a938-f05d436b4059 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32032024-08-27T19:04:48.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c9e8f11-4577-4e90-a938-f05d436b4059 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32042024-08-27T19:04:49.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66eee144-4c5e-4256-8ec4-9362146f8df8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32052024-08-27T19:04:49.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66eee144-4c5e-4256-8ec4-9362146f8df8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32062024-08-27T19:04:49.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66eee144-4c5e-4256-8ec4-9362146f8df8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32072024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
32082024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32092024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
32102024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32112024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32122024-08-27T19:04:50.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32132024-08-27T19:04:50.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32142024-08-27T19:04:50.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32152024-08-27T19:04:50.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162024-08-27T19:04:50.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.174005ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32172024-08-27T19:04:50.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32182024-08-27T19:04:50.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32192024-08-27T19:04:50.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32202024-08-27T19:04:50.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32212024-08-27T19:04:50.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32222024-08-27T19:04:50.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32232024-08-27T19:04:50.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
32242024-08-27T19:04:50.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32252024-08-27T19:04:50.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32262024-08-27T19:04:50.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
32272024-08-27T19:04:50.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.036457ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
32282024-08-27T19:04:50.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 542 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 2f5529f6-b082-45f3-94df-1253ff6d7d00 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
32292024-08-27T19:04:50.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 07e28141-82e3-4029-a637-006d093adb6e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32302024-08-27T19:04:50.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 07e28141-82e3-4029-a637-006d093adb6e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32312024-08-27T19:04:50.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 07e28141-82e3-4029-a637-006d093adb6e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32322024-08-27T19:04:51.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3251f7b5-2012-4812-8b9c-994ec2e11609 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32332024-08-27T19:04:51.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3251f7b5-2012-4812-8b9c-994ec2e11609 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32342024-08-27T19:04:51.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3251f7b5-2012-4812-8b9c-994ec2e11609 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32352024-08-27T19:04:52.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e37c580-5955-4033-8863-a5e0f4877bd5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32362024-08-27T19:04:52.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e37c580-5955-4033-8863-a5e0f4877bd5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32372024-08-27T19:04:52.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e37c580-5955-4033-8863-a5e0f4877bd5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32382024-08-27T19:04:53.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = befd84dc-fafd-4a38-90e9-16c73bba6cdc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32392024-08-27T19:04:53.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = befd84dc-fafd-4a38-90e9-16c73bba6cdc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32402024-08-27T19:04:53.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = befd84dc-fafd-4a38-90e9-16c73bba6cdc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32412024-08-27T19:04:54.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4065cbff-ab47-4259-956d-16729bc8dd7a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32422024-08-27T19:04:54.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4065cbff-ab47-4259-956d-16729bc8dd7a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32432024-08-27T19:04:54.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4065cbff-ab47-4259-956d-16729bc8dd7a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32442024-08-27T19:04:55.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8124abc2-c4dd-4747-9b22-c4609ad87721 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32452024-08-27T19:04:55.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8124abc2-c4dd-4747-9b22-c4609ad87721 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32462024-08-27T19:04:55.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8124abc2-c4dd-4747-9b22-c4609ad87721 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32472024-08-27T19:04:56.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ff1ee77-2256-4e9e-8f94-34e38cfd99a3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32482024-08-27T19:04:56.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ff1ee77-2256-4e9e-8f94-34e38cfd99a3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32492024-08-27T19:04:56.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ff1ee77-2256-4e9e-8f94-34e38cfd99a3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32502024-08-27T19:04:58.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f46915-a9f5-46b6-9564-e18a3fd1501f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32512024-08-27T19:04:58.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f46915-a9f5-46b6-9564-e18a3fd1501f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32522024-08-27T19:04:58.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f46915-a9f5-46b6-9564-e18a3fd1501f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32532024-08-27T19:04:59.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d8fcea5-0ef0-463a-b066-1f53a97f0151 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32542024-08-27T19:04:59.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d8fcea5-0ef0-463a-b066-1f53a97f0151 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32552024-08-27T19:04:59.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d8fcea5-0ef0-463a-b066-1f53a97f0151 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32562024-08-27T19:05:00.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a889aa1f-d61e-4b24-b09a-ebc65149cb37 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32572024-08-27T19:05:00.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a889aa1f-d61e-4b24-b09a-ebc65149cb37 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32582024-08-27T19:05:00.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a889aa1f-d61e-4b24-b09a-ebc65149cb37 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
32592024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
32602024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
32612024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32622024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32632024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
32642024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32652024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32662024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
32672024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
32682024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32692024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
32702024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
32712024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32722024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32732024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
32742024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32752024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
32762024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32772024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
32782024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
32792024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32802024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32812024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
32822024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32832024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
32842024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32852024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
32862024-08-27T19:05:00.249ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
32872024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32882024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
32892024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
32912024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32922024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32932024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32942024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32952024-08-27T19:05:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32962024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32972024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32982024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32992024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33002024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33012024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33022024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33032024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33042024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33052024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33062024-08-27T19:05:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33072024-08-27T19:05:00.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-08-27T19:05:00.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33092024-08-27T19:05:00.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102024-08-27T19:05:00.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 893361470 } })
33112024-08-27T19:05:00.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-08-27T19:05:00.259ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.151547ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33132024-08-27T19:05:00.259ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33142024-08-27T19:05:00.259ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33152024-08-27T19:05:00.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33162024-08-27T19:05:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33172024-08-27T19:05:00.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.76887ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
33182024-08-27T19:05:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33192024-08-27T19:05:00.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33202024-08-27T19:05:00.260ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 894912071 } })
33212024-08-27T19:05:00.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
33222024-08-27T19:05:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33232024-08-27T19:05:00.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33242024-08-27T19:05:00.262ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
33252024-08-27T19:05:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33262024-08-27T19:05:00.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33272024-08-27T19:05:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33282024-08-27T19:05:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33292024-08-27T19:05:00.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33302024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33312024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33322024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33332024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33342024-08-27T19:05:00.263ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33352024-08-27T19:05:00.263ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33362024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 14.330282ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
33372024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33382024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33392024-08-27T19:05:00.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33402024-08-27T19:05:00.264ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33412024-08-27T19:05:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33422024-08-27T19:05:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33432024-08-27T19:05:00.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33442024-08-27T19:05:00.265ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33452024-08-27T19:05:00.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462024-08-27T19:05:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33472024-08-27T19:05:00.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33482024-08-27T19:05:00.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33492024-08-27T19:05:00.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33502024-08-27T19:05:00.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33512024-08-27T19:05:00.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.307203ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33522024-08-27T19:05:00.266ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 901411204 } })
33532024-08-27T19:05:00.266ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33542024-08-27T19:05:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33552024-08-27T19:05:00.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33562024-08-27T19:05:00.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33572024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33582024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33592024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33602024-08-27T19:05:00.268ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
33612024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33622024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33632024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33642024-08-27T19:05:00.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.006568ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33652024-08-27T19:05:00.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33662024-08-27T19:05:00.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 20.0718ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
33672024-08-27T19:05:00.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
33682024-08-27T19:05:00.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33692024-08-27T19:05:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33702024-08-27T19:05:00.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33712024-08-27T19:05:00.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33722024-08-27T19:05:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33732024-08-27T19:05:00.271ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33742024-08-27T19:05:00.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.458338ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33752024-08-27T19:05:00.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 27.169645ms iteration = 8 status = {"physical_disks_added":0}
33762024-08-27T19:05:00.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
33772024-08-27T19:05:00.276ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.280296ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
33782024-08-27T19:05:00.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33792024-08-27T19:05:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33802024-08-27T19:05:00.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33812024-08-27T19:05:00.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33822024-08-27T19:05:00.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33832024-08-27T19:05:00.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
33842024-08-27T19:05:00.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33852024-08-27T19:05:00.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33862024-08-27T19:05:00.295ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 46.104631ms iteration = 6 status = 0
33872024-08-27T19:05:00.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33882024-08-27T19:05:00.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33892024-08-27T19:05:00.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33902024-08-27T19:05:00.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33912024-08-27T19:05:00.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33922024-08-27T19:05:00.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33932024-08-27T19:05:00.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33942024-08-27T19:05:00.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33952024-08-27T19:05:00.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33962024-08-27T19:05:00.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33972024-08-27T19:05:00.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33982024-08-27T19:05:00.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33992024-08-27T19:05:00.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002024-08-27T19:05:00.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34012024-08-27T19:05:00.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34022024-08-27T19:05:00.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34032024-08-27T19:05:00.339ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
34042024-08-27T19:05:00.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.096248ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34052024-08-27T19:05:00.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
34062024-08-27T19:05:00.371ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34072024-08-27T19:05:00.371ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d2780c9-8d9e-498b-a60f-65e628ac1ea4", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34082024-08-27T19:05:00.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34092024-08-27T19:05:00.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34102024-08-27T19:05:00.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
34112024-08-27T19:05:00.382ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34122024-08-27T19:05:00.383ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45c517a3-00ea-41b9-9190-053306003866", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34132024-08-27T19:05:00.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34142024-08-27T19:05:00.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
34152024-08-27T19:05:00.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
34162024-08-27T19:05:00.385ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34172024-08-27T19:05:00.385ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77bd45bd-eff7-478d-9331-e48ed5e56485", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34182024-08-27T19:05:00.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34192024-08-27T19:05:00.386ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34202024-08-27T19:05:00.390ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34212024-08-27T19:05:00.391ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7ae2157-8baf-4ee9-83f5-a3c511aeef92", "content-length": "372", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34222024-08-27T19:05:00.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34232024-08-27T19:05:00.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34242024-08-27T19:05:00.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34252024-08-27T19:05:00.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34262024-08-27T19:05:00.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34272024-08-27T19:05:00.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34282024-08-27T19:05:00.398ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34292024-08-27T19:05:00.399ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f859d742-08b0-41e8-85c7-9d5329ddd3a8", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34302024-08-27T19:05:00.400ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 150.832548ms iteration = 6 status = {}
34312024-08-27T19:05:00.450ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34322024-08-27T19:05:00.451ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbea8bab-19c3-4d7b-8ef2-9c507373c399", "content-length": "691", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34332024-08-27T19:05:00.452ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34342024-08-27T19:05:00.452ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34352024-08-27T19:05:00.452ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34362024-08-27T19:05:00.453ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 203.630896ms iteration = 6 status = {}
34372024-08-27T19:05:00.477ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 228.028064ms iteration = 6 status = {}
34382024-08-27T19:05:00.483ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34392024-08-27T19:05:00.484ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5da1c58e-515d-48b8-a209-7bacb9201d36", "content-length": "1", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34402024-08-27T19:05:00.486ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34412024-08-27T19:05:00.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34422024-08-27T19:05:00.488ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.837995ms iteration = 6 status = null
34432024-08-27T19:05:00.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34442024-08-27T19:05:00.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34452024-08-27T19:05:00.555ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
34462024-08-27T19:05:00.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34472024-08-27T19:05:00.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34482024-08-27T19:05:00.562ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34492024-08-27T19:05:00.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7003f0d4-2fa9-4607-9f0c-ae5bf8cfb1eb", "content-length": "121", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34502024-08-27T19:05:00.562ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
34512024-08-27T19:05:00.562ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
34522024-08-27T19:05:00.563ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34532024-08-27T19:05:00.563ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34542024-08-27T19:05:00.563ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
34552024-08-27T19:05:00.563ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
34562024-08-27T19:05:00.563ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
34572024-08-27T19:05:00.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34582024-08-27T19:05:00.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34592024-08-27T19:05:00.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34602024-08-27T19:05:00.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e283c63-49de-4252-9779-b08f446b3c81", "content-length": "2", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34612024-08-27T19:05:00.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34622024-08-27T19:05:00.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab753a13-0cdf-404d-b45b-5dd6adc5ee54", "content-length": "52", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34632024-08-27T19:05:00.564ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
34642024-08-27T19:05:00.564ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34652024-08-27T19:05:00.664ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d2f3b98c-cb3d-43ab-a32b-1ddce4a8cd35", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34662024-08-27T19:05:00.664ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
34672024-08-27T19:05:00.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34682024-08-27T19:05:00.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec457098-ec1a-46d8-8512-0e8810da91f7", "content-length": "667", "date": "Tue, 27 Aug 2024 19:05:00 GMT"} })
34692024-08-27T19:05:00.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34702024-08-27T19:05:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34712024-08-27T19:05:00.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34722024-08-27T19:05:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34732024-08-27T19:05:00.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34742024-08-27T19:05:00.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34752024-08-27T19:05:00.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34762024-08-27T19:05:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34772024-08-27T19:05:00.768ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.024563ms iteration = 6 status = {}
34782024-08-27T19:05:00.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 601 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 600a2e81-7443-4b2a-bc50-e38a1533d3b9 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
34792024-08-27T19:05:00.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 1e9f589a-8619-4075-8131-509e9d9b0f1a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
34802024-08-27T19:05:00.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 1e9f589a-8619-4075-8131-509e9d9b0f1a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
34812024-08-27T19:05:00.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 1e9f589a-8619-4075-8131-509e9d9b0f1a response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
34822024-08-27T19:05:01.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7504432-8eb9-4786-bb2e-881c6f17033a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34832024-08-27T19:05:01.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7504432-8eb9-4786-bb2e-881c6f17033a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34842024-08-27T19:05:01.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7504432-8eb9-4786-bb2e-881c6f17033a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34852024-08-27T19:05:02.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc9be7e-d477-4a6c-86d3-25f660159ef0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34862024-08-27T19:05:02.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc9be7e-d477-4a6c-86d3-25f660159ef0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34872024-08-27T19:05:02.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc9be7e-d477-4a6c-86d3-25f660159ef0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34882024-08-27T19:05:03.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2cdc25c-1f05-4e1f-9e9f-d66fcd2829a5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34892024-08-27T19:05:03.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2cdc25c-1f05-4e1f-9e9f-d66fcd2829a5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34902024-08-27T19:05:03.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2cdc25c-1f05-4e1f-9e9f-d66fcd2829a5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34912024-08-27T19:05:04.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4625950-324c-4696-9d64-fe8a64fc1d93 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34922024-08-27T19:05:04.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4625950-324c-4696-9d64-fe8a64fc1d93 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34932024-08-27T19:05:04.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4625950-324c-4696-9d64-fe8a64fc1d93 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34942024-08-27T19:05:05.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f4cc8ada-e7d6-43b3-ae84-1ae8100c4a1b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34952024-08-27T19:05:05.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f4cc8ada-e7d6-43b3-ae84-1ae8100c4a1b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34962024-08-27T19:05:05.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f4cc8ada-e7d6-43b3-ae84-1ae8100c4a1b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34972024-08-27T19:05:06.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d938430f-0d40-4642-9ec2-a1839af10df8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34982024-08-27T19:05:06.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d938430f-0d40-4642-9ec2-a1839af10df8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
34992024-08-27T19:05:06.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d938430f-0d40-4642-9ec2-a1839af10df8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35002024-08-27T19:05:07.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a2cd0567-2f93-43af-a2ec-d50d2c1a1ce9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35012024-08-27T19:05:07.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a2cd0567-2f93-43af-a2ec-d50d2c1a1ce9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35022024-08-27T19:05:07.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a2cd0567-2f93-43af-a2ec-d50d2c1a1ce9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35032024-08-27T19:05:08.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c588f6c2-336e-4beb-9168-619d0b01d8b1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35042024-08-27T19:05:08.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c588f6c2-336e-4beb-9168-619d0b01d8b1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35052024-08-27T19:05:08.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c588f6c2-336e-4beb-9168-619d0b01d8b1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35062024-08-27T19:05:09.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 26228bf5-0646-4bd7-a0fc-8731f964a7d2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35072024-08-27T19:05:09.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 26228bf5-0646-4bd7-a0fc-8731f964a7d2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35082024-08-27T19:05:09.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 26228bf5-0646-4bd7-a0fc-8731f964a7d2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35092024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
35102024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
35112024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35122024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35132024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35142024-08-27T19:05:10.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35152024-08-27T19:05:10.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35162024-08-27T19:05:10.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35172024-08-27T19:05:10.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35182024-08-27T19:05:10.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.586203ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35192024-08-27T19:05:10.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35202024-08-27T19:05:10.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35212024-08-27T19:05:10.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35222024-08-27T19:05:10.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35232024-08-27T19:05:10.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35242024-08-27T19:05:10.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252024-08-27T19:05:10.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
35262024-08-27T19:05:10.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35272024-08-27T19:05:10.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35282024-08-27T19:05:10.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
35292024-08-27T19:05:10.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.543027ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
35302024-08-27T19:05:10.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a42896c2-a2ac-4e1c-875d-54eef9cd68f1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35312024-08-27T19:05:10.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a42896c2-a2ac-4e1c-875d-54eef9cd68f1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35322024-08-27T19:05:10.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a42896c2-a2ac-4e1c-875d-54eef9cd68f1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35332024-08-27T19:05:10.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 463 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 6c2b2580-f75a-4fd8-ba3b-9532ca7cc7de response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
35342024-08-27T19:05:11.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c661d6cb-0317-4cbf-b2a2-31f2d28a284f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35352024-08-27T19:05:11.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c661d6cb-0317-4cbf-b2a2-31f2d28a284f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35362024-08-27T19:05:11.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c661d6cb-0317-4cbf-b2a2-31f2d28a284f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35372024-08-27T19:05:12.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7248bd4b-cbc6-4638-9861-3f52a4b6e09e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35382024-08-27T19:05:12.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7248bd4b-cbc6-4638-9861-3f52a4b6e09e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35392024-08-27T19:05:12.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7248bd4b-cbc6-4638-9861-3f52a4b6e09e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35402024-08-27T19:05:13.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58e24010-9aed-46f3-b32c-197b8c3d61aa roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35412024-08-27T19:05:13.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58e24010-9aed-46f3-b32c-197b8c3d61aa resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35422024-08-27T19:05:13.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58e24010-9aed-46f3-b32c-197b8c3d61aa response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35432024-08-27T19:05:14.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47bae0bc-3d10-4f20-a6fc-8c73a130066f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35442024-08-27T19:05:14.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47bae0bc-3d10-4f20-a6fc-8c73a130066f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35452024-08-27T19:05:14.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 47bae0bc-3d10-4f20-a6fc-8c73a130066f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35462024-08-27T19:05:15.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3979e89-04fc-42d7-86c1-0f14e1080cdd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35472024-08-27T19:05:15.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3979e89-04fc-42d7-86c1-0f14e1080cdd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35482024-08-27T19:05:15.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3979e89-04fc-42d7-86c1-0f14e1080cdd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35492024-08-27T19:05:16.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfb5dc2f-9324-4273-88a5-a7b2f2e4d484 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35502024-08-27T19:05:16.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfb5dc2f-9324-4273-88a5-a7b2f2e4d484 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35512024-08-27T19:05:16.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfb5dc2f-9324-4273-88a5-a7b2f2e4d484 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35522024-08-27T19:05:17.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15f3c7c8-5250-4877-966c-9dc381db5328 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35532024-08-27T19:05:17.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15f3c7c8-5250-4877-966c-9dc381db5328 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35542024-08-27T19:05:17.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15f3c7c8-5250-4877-966c-9dc381db5328 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35552024-08-27T19:05:18.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eeee5bec-1447-4bf3-8926-093f7ee2ed7c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35562024-08-27T19:05:18.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eeee5bec-1447-4bf3-8926-093f7ee2ed7c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35572024-08-27T19:05:18.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eeee5bec-1447-4bf3-8926-093f7ee2ed7c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35582024-08-27T19:05:19.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15c0050c-b764-42eb-98d9-430f6e1eaff4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35592024-08-27T19:05:19.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15c0050c-b764-42eb-98d9-430f6e1eaff4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35602024-08-27T19:05:19.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15c0050c-b764-42eb-98d9-430f6e1eaff4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35612024-08-27T19:05:20.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
35622024-08-27T19:05:20.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35632024-08-27T19:05:20.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
35642024-08-27T19:05:20.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35652024-08-27T19:05:20.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35662024-08-27T19:05:20.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35672024-08-27T19:05:20.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682024-08-27T19:05:20.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35692024-08-27T19:05:20.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35702024-08-27T19:05:20.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.44274ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35712024-08-27T19:05:20.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35722024-08-27T19:05:20.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35732024-08-27T19:05:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35742024-08-27T19:05:20.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35752024-08-27T19:05:20.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35762024-08-27T19:05:20.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-08-27T19:05:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
35782024-08-27T19:05:20.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35792024-08-27T19:05:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35802024-08-27T19:05:20.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
35812024-08-27T19:05:20.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.097478ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
35822024-08-27T19:05:20.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dfab5ac-beff-4b1b-8685-cc71bf40c787 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35832024-08-27T19:05:20.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dfab5ac-beff-4b1b-8685-cc71bf40c787 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35842024-08-27T19:05:20.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0dfab5ac-beff-4b1b-8685-cc71bf40c787 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35852024-08-27T19:05:20.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 470 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 86830f66-cd29-4e5d-9d62-2792f8486ad6 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
35862024-08-27T19:05:21.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34037098-7b49-446f-bb9f-ffe2c73c4480 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35872024-08-27T19:05:21.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34037098-7b49-446f-bb9f-ffe2c73c4480 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35882024-08-27T19:05:21.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34037098-7b49-446f-bb9f-ffe2c73c4480 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35892024-08-27T19:05:22.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a0d234dc-9481-436d-b6a4-9b6a9d1c94d3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35902024-08-27T19:05:22.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a0d234dc-9481-436d-b6a4-9b6a9d1c94d3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35912024-08-27T19:05:22.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a0d234dc-9481-436d-b6a4-9b6a9d1c94d3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35922024-08-27T19:05:23.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 577de48a-dfc2-46ed-a39b-7063f101b91f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35932024-08-27T19:05:23.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 577de48a-dfc2-46ed-a39b-7063f101b91f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35942024-08-27T19:05:23.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 577de48a-dfc2-46ed-a39b-7063f101b91f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35952024-08-27T19:05:24.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1107a265-1492-48a1-aa43-6cdf5dc0a1e7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35962024-08-27T19:05:24.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1107a265-1492-48a1-aa43-6cdf5dc0a1e7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35972024-08-27T19:05:24.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1107a265-1492-48a1-aa43-6cdf5dc0a1e7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35982024-08-27T19:05:25.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce54b53-c63a-46e4-9d67-4229e9edfdeb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
35992024-08-27T19:05:25.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce54b53-c63a-46e4-9d67-4229e9edfdeb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36002024-08-27T19:05:25.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce54b53-c63a-46e4-9d67-4229e9edfdeb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36012024-08-27T19:05:26.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec24b42f-97af-415b-adbf-c6cad9565cdc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36022024-08-27T19:05:26.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec24b42f-97af-415b-adbf-c6cad9565cdc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36032024-08-27T19:05:26.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec24b42f-97af-415b-adbf-c6cad9565cdc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36042024-08-27T19:05:27.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7d49311-8c18-4196-bfe8-57c3bb487e00 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36052024-08-27T19:05:27.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7d49311-8c18-4196-bfe8-57c3bb487e00 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36062024-08-27T19:05:27.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7d49311-8c18-4196-bfe8-57c3bb487e00 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36072024-08-27T19:05:28.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 233fddec-10cd-4eb1-902f-b2dd85eb5628 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36082024-08-27T19:05:28.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 233fddec-10cd-4eb1-902f-b2dd85eb5628 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36092024-08-27T19:05:28.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 233fddec-10cd-4eb1-902f-b2dd85eb5628 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36102024-08-27T19:05:29.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89055841-b3d2-41f0-8926-a72627394d54 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36112024-08-27T19:05:29.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89055841-b3d2-41f0-8926-a72627394d54 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36122024-08-27T19:05:29.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89055841-b3d2-41f0-8926-a72627394d54 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
36132024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
36142024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
36152024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
36162024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36172024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
36182024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36192024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
36202024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
36212024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
36222024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36232024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36242024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
36252024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
36262024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36272024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
36282024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
36292024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36302024-08-27T19:05:30.250ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:55:30.250616637 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
36312024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
36322024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
36332024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
36342024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36352024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
36362024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
36372024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
36382024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
36392024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36402024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
36412024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36422024-08-27T19:05:30.250ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
36432024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
36442024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36452024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36462024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
36472024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36482024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36492024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
36502024-08-27T19:05:30.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
36512024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36522024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
36532024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36542024-08-27T19:05:30.251ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
36552024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.62\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
36562024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
36572024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
36582024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36592024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36602024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36612024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36622024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
36632024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36642024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36652024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36662024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36672024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
36682024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
36692024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36702024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36712024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
36722024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36732024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36742024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
36752024-08-27T19:05:30.251ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
36762024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36772024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
36782024-08-27T19:05:30.251ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
36792024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
36802024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36812024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36822024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36832024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36842024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36852024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36862024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36872024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36882024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36892024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36902024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36912024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36922024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36932024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36942024-08-27T19:05:30.251ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 884267636 } })
36952024-08-27T19:05:30.251ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 884270056 } })
36962024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36972024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36982024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36992024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37002024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37012024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37022024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37032024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37042024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37052024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37062024-08-27T19:05:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37072024-08-27T19:05:30.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37082024-08-27T19:05:30.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37092024-08-27T19:05:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37102024-08-27T19:05:30.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37112024-08-27T19:05:30.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122024-08-27T19:05:30.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37132024-08-27T19:05:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37142024-08-27T19:05:30.254ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
37152024-08-27T19:05:30.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.9123ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
37162024-08-27T19:05:30.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-08-27T19:05:30.254ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
37182024-08-27T19:05:30.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.91833ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
37192024-08-27T19:05:30.255ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:55:30.250616637 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
37202024-08-27T19:05:30.255ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.41383ms iteration = 4 status = {"expiration":"2024-08-27T18:55:30.250616637Z","pruned":[]}
37212024-08-27T19:05:30.255ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.444191ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37222024-08-27T19:05:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37232024-08-27T19:05:30.256ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 889062813 } })
37242024-08-27T19:05:30.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252024-08-27T19:05:30.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
37262024-08-27T19:05:30.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37272024-08-27T19:05:30.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37282024-08-27T19:05:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37292024-08-27T19:05:30.257ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37302024-08-27T19:05:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37312024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37322024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37332024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37342024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37352024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37362024-08-27T19:05:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37372024-08-27T19:05:30.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382024-08-27T19:05:30.259ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37402024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37412024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37422024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37432024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
37442024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37452024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37462024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37472024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37482024-08-27T19:05:30.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37492024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37502024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37512024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37522024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37532024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37542024-08-27T19:05:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37552024-08-27T19:05:30.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.212169ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37562024-08-27T19:05:30.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37572024-08-27T19:05:30.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 894972224 } })
37582024-08-27T19:05:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592024-08-27T19:05:30.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37602024-08-27T19:05:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37612024-08-27T19:05:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37622024-08-27T19:05:30.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37632024-08-27T19:05:30.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37642024-08-27T19:05:30.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
37652024-08-27T19:05:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37662024-08-27T19:05:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37672024-08-27T19:05:30.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 897349503 } })
37682024-08-27T19:05:30.264ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
37692024-08-27T19:05:30.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37702024-08-27T19:05:30.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37712024-08-27T19:05:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37722024-08-27T19:05:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37732024-08-27T19:05:30.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37742024-08-27T19:05:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37752024-08-27T19:05:30.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37762024-08-27T19:05:30.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37772024-08-27T19:05:30.275ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37782024-08-27T19:05:30.275ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37792024-08-27T19:05:30.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37802024-08-27T19:05:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37812024-08-27T19:05:30.285ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37822024-08-27T19:05:30.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.81871ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37832024-08-27T19:05:30.287ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 36.420144ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
37842024-08-27T19:05:30.288ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37852024-08-27T19:05:30.288ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37862024-08-27T19:05:30.288ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 37.298262ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
37872024-08-27T19:05:30.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37882024-08-27T19:05:30.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37892024-08-27T19:05:30.292ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37902024-08-27T19:05:30.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37912024-08-27T19:05:30.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37922024-08-27T19:05:30.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37932024-08-27T19:05:30.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37942024-08-27T19:05:30.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37952024-08-27T19:05:30.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37962024-08-27T19:05:30.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37972024-08-27T19:05:30.297ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37982024-08-27T19:05:30.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37992024-08-27T19:05:30.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38002024-08-27T19:05:30.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.537711ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38012024-08-27T19:05:30.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38022024-08-27T19:05:30.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38032024-08-27T19:05:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38042024-08-27T19:05:30.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38052024-08-27T19:05:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38062024-08-27T19:05:30.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072024-08-27T19:05:30.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38082024-08-27T19:05:30.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38092024-08-27T19:05:30.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-08-27T19:05:30.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38112024-08-27T19:05:30.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38122024-08-27T19:05:30.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
38132024-08-27T19:05:30.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38142024-08-27T19:05:30.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38152024-08-27T19:05:30.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38162024-08-27T19:05:30.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38172024-08-27T19:05:30.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38182024-08-27T19:05:30.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38192024-08-27T19:05:30.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38202024-08-27T19:05:30.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38212024-08-27T19:05:30.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38222024-08-27T19:05:30.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38232024-08-27T19:05:30.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38242024-08-27T19:05:30.307ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
38252024-08-27T19:05:30.307ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
38262024-08-27T19:05:30.307ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.768829ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
38272024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
38282024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38292024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38302024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38312024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38322024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38332024-08-27T19:05:30.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38342024-08-27T19:05:30.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38352024-08-27T19:05:30.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38362024-08-27T19:05:30.312ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38372024-08-27T19:05:30.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38382024-08-27T19:05:30.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38392024-08-27T19:05:30.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38402024-08-27T19:05:30.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38412024-08-27T19:05:30.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.073979ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
38422024-08-27T19:05:30.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.390926ms iteration = 7 status = 0
38432024-08-27T19:05:30.320ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 69.626281ms iteration = 3 status = {"nsuccess":5}
38442024-08-27T19:05:30.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452024-08-27T19:05:30.321ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38462024-08-27T19:05:30.321ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38472024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38482024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38492024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38502024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38512024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38522024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
38532024-08-27T19:05:30.322ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
38542024-08-27T19:05:30.322ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.239794ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
38552024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38562024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38572024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38582024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38592024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38602024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38612024-08-27T19:05:30.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38622024-08-27T19:05:30.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38632024-08-27T19:05:30.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38642024-08-27T19:05:30.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-08-27T19:05:30.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38662024-08-27T19:05:30.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.856718ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
38672024-08-27T19:05:30.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38682024-08-27T19:05:30.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38692024-08-27T19:05:30.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38702024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
38712024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
38722024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38732024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38742024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38752024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38762024-08-27T19:05:30.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38772024-08-27T19:05:30.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38782024-08-27T19:05:30.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
38792024-08-27T19:05:30.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38802024-08-27T19:05:30.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38812024-08-27T19:05:30.330ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38822024-08-27T19:05:30.330ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38832024-08-27T19:05:30.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38842024-08-27T19:05:30.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38852024-08-27T19:05:30.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38862024-08-27T19:05:30.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38872024-08-27T19:05:30.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38882024-08-27T19:05:30.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38892024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
38902024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
38912024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
38922024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 83.593246ms iteration = 4 status = {"generation":2}
38932024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38942024-08-27T19:05:30.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38952024-08-27T19:05:30.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38962024-08-27T19:05:30.335ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
38972024-08-27T19:05:30.335ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.76053ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
38982024-08-27T19:05:30.337ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
38992024-08-27T19:05:30.337ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39002024-08-27T19:05:30.337ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
39012024-08-27T19:05:30.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 86.7127ms iteration = 4 status = {"generation":1}
39022024-08-27T19:05:30.339ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39032024-08-27T19:05:30.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39042024-08-27T19:05:30.340ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39052024-08-27T19:05:30.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39062024-08-27T19:05:30.363ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
39072024-08-27T19:05:30.363ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 112.565827ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39082024-08-27T19:05:30.375ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
39092024-08-27T19:05:30.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.689535ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39102024-08-27T19:05:30.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
39112024-08-27T19:05:30.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
39122024-08-27T19:05:30.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
39132024-08-27T19:05:30.432ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39142024-08-27T19:05:30.434ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9fd20745-144c-4bcf-b7f8-72cdc17ebc2a", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39152024-08-27T19:05:30.434ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39162024-08-27T19:05:30.436ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39172024-08-27T19:05:30.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
39182024-08-27T19:05:30.453ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39192024-08-27T19:05:30.453ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0758e2d-63d7-4c5a-86ac-a014fca1994b", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39202024-08-27T19:05:30.453ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39212024-08-27T19:05:30.456ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39222024-08-27T19:05:30.482ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
39232024-08-27T19:05:30.482ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39242024-08-27T19:05:30.482ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf94ac1-3963-488f-bc80-dfe9abe62850", "content-length": "26", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39252024-08-27T19:05:30.482ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39262024-08-27T19:05:30.484ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
39272024-08-27T19:05:30.509ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39282024-08-27T19:05:30.510ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "897579c4-9fb0-4d8f-8a81-0372ee06ecdc", "content-length": "691", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39292024-08-27T19:05:30.511ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39302024-08-27T19:05:30.511ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39312024-08-27T19:05:30.511ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39322024-08-27T19:05:30.511ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.332054ms iteration = 7 status = {}
39332024-08-27T19:05:30.520ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39342024-08-27T19:05:30.521ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eff3dd2c-5f89-4d42-a9c0-9bb04fedf219", "content-length": "372", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39352024-08-27T19:05:30.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39362024-08-27T19:05:30.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39372024-08-27T19:05:30.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39382024-08-27T19:05:30.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39392024-08-27T19:05:30.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39402024-08-27T19:05:30.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39412024-08-27T19:05:30.529ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39422024-08-27T19:05:30.529ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a13964b1-9231-41ab-b57f-b2e1f5bd1519", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39432024-08-27T19:05:30.530ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.431313ms iteration = 7 status = {}
39442024-08-27T19:05:30.543ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 293.092502ms iteration = 9 status = {"physical_disks_added":0}
39452024-08-27T19:05:30.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
39462024-08-27T19:05:30.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89eae8de-696c-44ae-82ea-0c68c211c0d8", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39472024-08-27T19:05:30.562ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39482024-08-27T19:05:30.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "54ed7d02-e149-4893-ac13-8e4f4abe7573", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39492024-08-27T19:05:30.564ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39502024-08-27T19:05:30.565ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
39512024-08-27T19:05:30.565ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.864066ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
39522024-08-27T19:05:30.633ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
39532024-08-27T19:05:30.699ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 448.421822ms iteration = 7 status = {}
39542024-08-27T19:05:30.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ed9a0a-1b4f-4b43-985f-2ac5fe4e50ca roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
39552024-08-27T19:05:30.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ed9a0a-1b4f-4b43-985f-2ac5fe4e50ca resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
39562024-08-27T19:05:30.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 95ed9a0a-1b4f-4b43-985f-2ac5fe4e50ca response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
39572024-08-27T19:05:30.709ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39582024-08-27T19:05:30.710ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "65d6b302-8b5f-4469-87c7-02fb17749c4d", "content-length": "1", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39592024-08-27T19:05:30.711ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39602024-08-27T19:05:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39612024-08-27T19:05:30.713ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.084851ms iteration = 7 status = null
39622024-08-27T19:05:30.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39632024-08-27T19:05:30.743ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6918d883-12e3-476b-abdd-10b99f9f1a24", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39642024-08-27T19:05:30.743ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39652024-08-27T19:05:30.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "39d47ccb-8249-415f-a4ca-f9340f53ea62", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39662024-08-27T19:05:30.745ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39672024-08-27T19:05:30.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d6a0262e-7b4f-420a-8af0-80bb745a29be", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39682024-08-27T19:05:30.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39692024-08-27T19:05:30.748ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
39702024-08-27T19:05:30.748ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 498.240509ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39712024-08-27T19:05:30.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39722024-08-27T19:05:30.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39732024-08-27T19:05:30.784ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
39742024-08-27T19:05:30.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39752024-08-27T19:05:30.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39762024-08-27T19:05:30.790ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39772024-08-27T19:05:30.790ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a54b986b-5f6d-40e7-a90e-086ed4e57bfc", "content-length": "121", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39782024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
39792024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
39802024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39812024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39822024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
39832024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
39842024-08-27T19:05:30.790ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
39852024-08-27T19:05:30.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39862024-08-27T19:05:30.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39872024-08-27T19:05:30.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39882024-08-27T19:05:30.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "125be3d9-2739-486e-9805-1cee6eec1c10", "content-length": "2", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39892024-08-27T19:05:30.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39902024-08-27T19:05:30.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "172b1e12-824c-4606-a7b9-af6db3dcbf9b", "content-length": "52", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39912024-08-27T19:05:30.792ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
39922024-08-27T19:05:30.792ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39932024-08-27T19:05:30.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 484 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = cda79e60-37b2-4f39-bfed-1b001e38ed9d response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
39942024-08-27T19:05:30.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b979198a-2278-4a0c-992e-3400d524f5c2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
39952024-08-27T19:05:30.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b979198a-2278-4a0c-992e-3400d524f5c2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
39962024-08-27T19:05:30.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = b979198a-2278-4a0c-992e-3400d524f5c2 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
39972024-08-27T19:05:30.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3f2d549d-8f92-4502-9c90-9090ebefcc45", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
39982024-08-27T19:05:30.961ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
39992024-08-27T19:05:30.961ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40002024-08-27T19:05:30.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b8e03fc9-7a44-49a3-af0a-f54827752589", "content-length": "667", "date": "Tue, 27 Aug 2024 19:05:30 GMT"} })
40012024-08-27T19:05:30.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40022024-08-27T19:05:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40032024-08-27T19:05:30.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40042024-08-27T19:05:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40052024-08-27T19:05:30.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40062024-08-27T19:05:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40072024-08-27T19:05:30.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40082024-08-27T19:05:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40092024-08-27T19:05:30.977ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 726.200512ms iteration = 7 status = {}
40102024-08-27T19:05:31.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1902c3e1-cdc3-4aff-a031-73bd40d9b7fe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40112024-08-27T19:05:31.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1902c3e1-cdc3-4aff-a031-73bd40d9b7fe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40122024-08-27T19:05:31.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1902c3e1-cdc3-4aff-a031-73bd40d9b7fe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40132024-08-27T19:05:32.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc0a8f0c-1ff9-4fbb-a33c-e7f040b4e9ba roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40142024-08-27T19:05:32.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc0a8f0c-1ff9-4fbb-a33c-e7f040b4e9ba resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40152024-08-27T19:05:32.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc0a8f0c-1ff9-4fbb-a33c-e7f040b4e9ba response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40162024-08-27T19:05:33.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1d2e2138-ed24-4fb3-83c1-e187fce4da5c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40172024-08-27T19:05:33.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1d2e2138-ed24-4fb3-83c1-e187fce4da5c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40182024-08-27T19:05:33.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1d2e2138-ed24-4fb3-83c1-e187fce4da5c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40192024-08-27T19:05:34.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ab0eeaf-79b2-488d-a522-de985818ec6d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40202024-08-27T19:05:34.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ab0eeaf-79b2-488d-a522-de985818ec6d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40212024-08-27T19:05:34.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ab0eeaf-79b2-488d-a522-de985818ec6d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40222024-08-27T19:05:35.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35d27571-2b00-4235-985c-9fc06fe58a81 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40232024-08-27T19:05:35.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35d27571-2b00-4235-985c-9fc06fe58a81 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40242024-08-27T19:05:35.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35d27571-2b00-4235-985c-9fc06fe58a81 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40252024-08-27T19:05:36.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4521eb00-9ff9-460c-b976-3181dc1ef237 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40262024-08-27T19:05:36.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4521eb00-9ff9-460c-b976-3181dc1ef237 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40272024-08-27T19:05:36.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4521eb00-9ff9-460c-b976-3181dc1ef237 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40282024-08-27T19:05:37.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ba703b3d-8abe-46e4-ace7-2e148906de25 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40292024-08-27T19:05:37.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ba703b3d-8abe-46e4-ace7-2e148906de25 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40302024-08-27T19:05:37.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ba703b3d-8abe-46e4-ace7-2e148906de25 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40312024-08-27T19:05:38.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fdc86876-9dcc-4ba1-8373-1c1c9961550e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40322024-08-27T19:05:38.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fdc86876-9dcc-4ba1-8373-1c1c9961550e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40332024-08-27T19:05:38.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fdc86876-9dcc-4ba1-8373-1c1c9961550e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40342024-08-27T19:05:39.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c118423a-8180-43b8-95a2-56f1008ce468 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40352024-08-27T19:05:39.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c118423a-8180-43b8-95a2-56f1008ce468 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40362024-08-27T19:05:39.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c118423a-8180-43b8-95a2-56f1008ce468 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40372024-08-27T19:05:40.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
40382024-08-27T19:05:40.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
40392024-08-27T19:05:40.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40402024-08-27T19:05:40.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40412024-08-27T19:05:40.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40422024-08-27T19:05:40.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40432024-08-27T19:05:40.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-08-27T19:05:40.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40452024-08-27T19:05:40.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40462024-08-27T19:05:40.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.43229ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40472024-08-27T19:05:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40482024-08-27T19:05:40.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40492024-08-27T19:05:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40502024-08-27T19:05:40.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40512024-08-27T19:05:40.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40522024-08-27T19:05:40.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-08-27T19:05:40.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
40542024-08-27T19:05:40.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40552024-08-27T19:05:40.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40562024-08-27T19:05:40.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
40572024-08-27T19:05:40.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.977857ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
40582024-08-27T19:05:40.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 543 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 936b4ed5-2165-452c-a8ba-2399e0357ac8 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
40592024-08-27T19:05:40.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7fe19a6-850f-43bd-a805-cd6405bf7f2c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40602024-08-27T19:05:40.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7fe19a6-850f-43bd-a805-cd6405bf7f2c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40612024-08-27T19:05:40.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7fe19a6-850f-43bd-a805-cd6405bf7f2c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40622024-08-27T19:05:41.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bb2c625-e21b-4d44-9f06-8501cc915a5a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40632024-08-27T19:05:41.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bb2c625-e21b-4d44-9f06-8501cc915a5a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40642024-08-27T19:05:41.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bb2c625-e21b-4d44-9f06-8501cc915a5a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40652024-08-27T19:05:42.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bc4beda2-cca7-48c1-b74f-741bcbb5b319 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40662024-08-27T19:05:42.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bc4beda2-cca7-48c1-b74f-741bcbb5b319 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40672024-08-27T19:05:42.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bc4beda2-cca7-48c1-b74f-741bcbb5b319 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40682024-08-27T19:05:43.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b9c6f57c-8754-4820-a9b8-255a9b1cb5ae roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40692024-08-27T19:05:43.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b9c6f57c-8754-4820-a9b8-255a9b1cb5ae resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40702024-08-27T19:05:43.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b9c6f57c-8754-4820-a9b8-255a9b1cb5ae response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40712024-08-27T19:05:45.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee8e402e-389c-486a-8d6e-2a10827534de roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40722024-08-27T19:05:45.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee8e402e-389c-486a-8d6e-2a10827534de resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40732024-08-27T19:05:45.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee8e402e-389c-486a-8d6e-2a10827534de response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40742024-08-27T19:05:46.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6bf20a62-a4ed-4683-99ce-d768a242eb74 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40752024-08-27T19:05:46.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6bf20a62-a4ed-4683-99ce-d768a242eb74 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40762024-08-27T19:05:46.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6bf20a62-a4ed-4683-99ce-d768a242eb74 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40772024-08-27T19:05:47.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ba6c593-bc54-4fb2-ac6d-a8cb1b5a6858 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40782024-08-27T19:05:47.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ba6c593-bc54-4fb2-ac6d-a8cb1b5a6858 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40792024-08-27T19:05:47.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ba6c593-bc54-4fb2-ac6d-a8cb1b5a6858 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40802024-08-27T19:05:48.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ba8c59a-609d-4444-b85d-1456c7101269 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40812024-08-27T19:05:48.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ba8c59a-609d-4444-b85d-1456c7101269 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40822024-08-27T19:05:48.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ba8c59a-609d-4444-b85d-1456c7101269 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40832024-08-27T19:05:49.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17a194c-b8bc-4dfc-88b2-75a22568f76e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40842024-08-27T19:05:49.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17a194c-b8bc-4dfc-88b2-75a22568f76e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40852024-08-27T19:05:49.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17a194c-b8bc-4dfc-88b2-75a22568f76e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40862024-08-27T19:05:50.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15fbc6b1-9679-437e-837d-b589e8ac7082 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40872024-08-27T19:05:50.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15fbc6b1-9679-437e-837d-b589e8ac7082 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40882024-08-27T19:05:50.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 15fbc6b1-9679-437e-837d-b589e8ac7082 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
40892024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
40902024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40912024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
40922024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40932024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40942024-08-27T19:05:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40952024-08-27T19:05:50.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40962024-08-27T19:05:50.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40972024-08-27T19:05:50.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40982024-08-27T19:05:50.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.089063ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40992024-08-27T19:05:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41002024-08-27T19:05:50.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41012024-08-27T19:05:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41022024-08-27T19:05:50.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41032024-08-27T19:05:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41042024-08-27T19:05:50.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41052024-08-27T19:05:50.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
41062024-08-27T19:05:50.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41072024-08-27T19:05:50.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41082024-08-27T19:05:50.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
41092024-08-27T19:05:50.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.030097ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
41102024-08-27T19:05:50.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 11e865ef-ec19-4fda-8bed-ce2b02e3976e response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
41112024-08-27T19:05:51.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ba493f4-f26f-4b63-9380-1a48c261433b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41122024-08-27T19:05:51.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ba493f4-f26f-4b63-9380-1a48c261433b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41132024-08-27T19:05:51.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ba493f4-f26f-4b63-9380-1a48c261433b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41142024-08-27T19:05:52.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e23e5ca5-c7bc-442e-a48b-f0c7243f60ba roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41152024-08-27T19:05:52.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e23e5ca5-c7bc-442e-a48b-f0c7243f60ba resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41162024-08-27T19:05:52.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e23e5ca5-c7bc-442e-a48b-f0c7243f60ba response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41172024-08-27T19:05:53.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bd0b4240-9298-42cd-a438-d014a98e7b1e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41182024-08-27T19:05:53.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bd0b4240-9298-42cd-a438-d014a98e7b1e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41192024-08-27T19:05:53.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bd0b4240-9298-42cd-a438-d014a98e7b1e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41202024-08-27T19:05:54.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e8b680a-8008-4da8-81da-ffd1b19009b5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41212024-08-27T19:05:54.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e8b680a-8008-4da8-81da-ffd1b19009b5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41222024-08-27T19:05:54.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e8b680a-8008-4da8-81da-ffd1b19009b5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41232024-08-27T19:05:55.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4fbdf8fc-6cd2-4e06-892f-a9353e9398b7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41242024-08-27T19:05:55.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4fbdf8fc-6cd2-4e06-892f-a9353e9398b7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41252024-08-27T19:05:55.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4fbdf8fc-6cd2-4e06-892f-a9353e9398b7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41262024-08-27T19:05:56.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6ddcf4e-677e-4bf9-a3aa-7fd38214af86 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41272024-08-27T19:05:56.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6ddcf4e-677e-4bf9-a3aa-7fd38214af86 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41282024-08-27T19:05:56.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6ddcf4e-677e-4bf9-a3aa-7fd38214af86 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41292024-08-27T19:05:57.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7ecc275c-a067-40cb-b90c-ba713b108749 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41302024-08-27T19:05:57.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7ecc275c-a067-40cb-b90c-ba713b108749 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41312024-08-27T19:05:57.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7ecc275c-a067-40cb-b90c-ba713b108749 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41322024-08-27T19:05:58.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fb4ba41c-a760-40c9-b198-f62a87654205 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41332024-08-27T19:05:58.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fb4ba41c-a760-40c9-b198-f62a87654205 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41342024-08-27T19:05:58.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fb4ba41c-a760-40c9-b198-f62a87654205 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41352024-08-27T19:05:59.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 590b91d3-85fe-4b99-83c1-4d961aea3b67 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41362024-08-27T19:05:59.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 590b91d3-85fe-4b99-83c1-4d961aea3b67 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41372024-08-27T19:05:59.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 590b91d3-85fe-4b99-83c1-4d961aea3b67 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
41382024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
41392024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
41402024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41412024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41422024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
41432024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41442024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
41452024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41462024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
41472024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41482024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
41492024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41502024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
41512024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
41522024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41532024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41542024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
41552024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
41562024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41572024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41582024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
41592024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41602024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
41612024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41622024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
41632024-08-27T19:06:00.250ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
41642024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41652024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
41662024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41672024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
41682024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41692024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
41702024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41712024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41722024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41732024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41752024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41762024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41772024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41782024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41792024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41802024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41812024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41822024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41832024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41842024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41852024-08-27T19:06:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41862024-08-27T19:06:00.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 885622493 } })
41872024-08-27T19:06:00.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882024-08-27T19:06:00.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
41892024-08-27T19:06:00.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-08-27T19:06:00.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912024-08-27T19:06:00.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 886973810 } })
41922024-08-27T19:06:00.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41932024-08-27T19:06:00.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
41942024-08-27T19:06:00.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41952024-08-27T19:06:00.253ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.627944ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41962024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972024-08-27T19:06:00.254ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41982024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41992024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42002024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42012024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42022024-08-27T19:06:00.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42032024-08-27T19:06:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42042024-08-27T19:06:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42052024-08-27T19:06:00.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42062024-08-27T19:06:00.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.858329ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42072024-08-27T19:06:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42082024-08-27T19:06:00.256ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
42092024-08-27T19:06:00.256ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42102024-08-27T19:06:00.256ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.91356ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
42112024-08-27T19:06:00.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.078775ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
42122024-08-27T19:06:00.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132024-08-27T19:06:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42142024-08-27T19:06:00.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42152024-08-27T19:06:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42162024-08-27T19:06:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42172024-08-27T19:06:00.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42182024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42192024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42202024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42212024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42222024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42232024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42242024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42252024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42262024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42272024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42282024-08-27T19:06:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42292024-08-27T19:06:00.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.80062ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
42302024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42312024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42322024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42332024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42342024-08-27T19:06:00.260ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 893924272 } })
42352024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42362024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42372024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42382024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42392024-08-27T19:06:00.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.467743ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42402024-08-27T19:06:00.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42412024-08-27T19:06:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42422024-08-27T19:06:00.261ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42432024-08-27T19:06:00.261ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.045786ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42442024-08-27T19:06:00.261ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
42452024-08-27T19:06:00.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42462024-08-27T19:06:00.261ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42472024-08-27T19:06:00.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42482024-08-27T19:06:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42492024-08-27T19:06:00.263ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
42502024-08-27T19:06:00.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.71716ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42512024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42522024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42532024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
42542024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42552024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42562024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42572024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42582024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42592024-08-27T19:06:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42602024-08-27T19:06:00.270ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
42612024-08-27T19:06:00.270ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.304994ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
42622024-08-27T19:06:00.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42632024-08-27T19:06:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42642024-08-27T19:06:00.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42652024-08-27T19:06:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42662024-08-27T19:06:00.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672024-08-27T19:06:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
42682024-08-27T19:06:00.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42692024-08-27T19:06:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42702024-08-27T19:06:00.284ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 34.549755ms iteration = 8 status = 0
42712024-08-27T19:06:00.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42722024-08-27T19:06:00.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42732024-08-27T19:06:00.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42742024-08-27T19:06:00.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42752024-08-27T19:06:00.305ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.697357ms iteration = 10 status = {"physical_disks_added":0}
42762024-08-27T19:06:00.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42772024-08-27T19:06:00.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42782024-08-27T19:06:00.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42792024-08-27T19:06:00.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42802024-08-27T19:06:00.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812024-08-27T19:06:00.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42822024-08-27T19:06:00.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42832024-08-27T19:06:00.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42842024-08-27T19:06:00.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = accf91d7-0a74-4118-8cd6-cc423bff9c0e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
42852024-08-27T19:06:00.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = accf91d7-0a74-4118-8cd6-cc423bff9c0e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
42862024-08-27T19:06:00.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = accf91d7-0a74-4118-8cd6-cc423bff9c0e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
42872024-08-27T19:06:00.361ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42882024-08-27T19:06:00.361ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42892024-08-27T19:06:00.362ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96aa7a21-741c-4cd5-9374-0a837beed90e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
42902024-08-27T19:06:00.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42912024-08-27T19:06:00.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42922024-08-27T19:06:00.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42932024-08-27T19:06:00.382ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42942024-08-27T19:06:00.383ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c537bae-ce93-4afe-bcfc-19d9c83d35c5", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
42952024-08-27T19:06:00.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42962024-08-27T19:06:00.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42972024-08-27T19:06:00.388ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42982024-08-27T19:06:00.388ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "51ae5640-3ed1-4552-95fb-bf4c081daff4", "content-length": "372", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
42992024-08-27T19:06:00.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43002024-08-27T19:06:00.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43012024-08-27T19:06:00.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43022024-08-27T19:06:00.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43032024-08-27T19:06:00.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43042024-08-27T19:06:00.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43052024-08-27T19:06:00.395ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43062024-08-27T19:06:00.395ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e43dcfc1-1edd-421c-84b8-2eeca38aa260", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43072024-08-27T19:06:00.396ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 146.135193ms iteration = 8 status = {}
43082024-08-27T19:06:00.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
43092024-08-27T19:06:00.462ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43102024-08-27T19:06:00.462ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8f18954-b9ca-4982-94b9-943ed075788c", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43112024-08-27T19:06:00.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43122024-08-27T19:06:00.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
43132024-08-27T19:06:00.503ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43142024-08-27T19:06:00.503ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "be9553d3-5d88-4b5d-a70a-cecc92635501", "content-length": "1", "date": "Tue, 27 Aug 2024 19:05:59 GMT"} })
43152024-08-27T19:06:00.505ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43162024-08-27T19:06:00.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43172024-08-27T19:06:00.507ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.28858ms iteration = 8 status = null
43182024-08-27T19:06:00.554ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43192024-08-27T19:06:00.554ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "833b1949-530e-4e72-ab86-9f022af8bb8a", "content-length": "691", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43202024-08-27T19:06:00.554ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43212024-08-27T19:06:00.554ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43222024-08-27T19:06:00.554ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43232024-08-27T19:06:00.556ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.839101ms iteration = 8 status = {}
43242024-08-27T19:06:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.321927ms iteration = 8 status = {}
43252024-08-27T19:06:00.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43262024-08-27T19:06:00.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43272024-08-27T19:06:00.629ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
43282024-08-27T19:06:00.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43292024-08-27T19:06:00.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43302024-08-27T19:06:00.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43312024-08-27T19:06:00.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b0904e-f19d-4c65-9d08-f8c3f28e2266", "content-length": "121", "date": "Tue, 27 Aug 2024 19:05:59 GMT"} })
43322024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
43332024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
43342024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43352024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43362024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
43372024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
43382024-08-27T19:06:00.636ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
43392024-08-27T19:06:00.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43402024-08-27T19:06:00.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43412024-08-27T19:06:00.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43422024-08-27T19:06:00.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0debab-c808-445a-b941-f9253d24b8ee", "content-length": "2", "date": "Tue, 27 Aug 2024 19:05:59 GMT"} })
43432024-08-27T19:06:00.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43442024-08-27T19:06:00.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "730e2424-6739-481a-b2bf-d37af8ea0fa0", "content-length": "52", "date": "Tue, 27 Aug 2024 19:05:59 GMT"} })
43452024-08-27T19:06:00.638ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
43462024-08-27T19:06:00.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43472024-08-27T19:06:00.783ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "610de9e1-0095-4566-85b7-5d1845ef48d5", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43482024-08-27T19:06:00.783ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
43492024-08-27T19:06:00.783ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43502024-08-27T19:06:00.784ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3924b4-b582-49a0-8f44-ec8a0b9bc238", "content-length": "667", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43512024-08-27T19:06:00.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43522024-08-27T19:06:00.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43532024-08-27T19:06:00.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43542024-08-27T19:06:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43552024-08-27T19:06:00.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43562024-08-27T19:06:00.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43572024-08-27T19:06:00.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43582024-08-27T19:06:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43592024-08-27T19:06:00.799ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 548.899432ms iteration = 8 status = {}
43602024-08-27T19:06:00.802ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
43612024-08-27T19:06:00.802ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
43622024-08-27T19:06:00.833ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
43632024-08-27T19:06:00.833ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33717
43642024-08-27T19:06:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = c25f6b80-75e7-48f6-ba74-63efe7b65a21 roles = RoleSet { roles: {} } uri = /metrics/producers
43652024-08-27T19:06:00.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = c25f6b80-75e7-48f6-ba74-63efe7b65a21 resource = Database result = Ok(()) uri = /metrics/producers
43662024-08-27T19:06:00.834ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 459 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 41471204-5d8b-4c29-9ae2-3d650332be97 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
43672024-08-27T19:06:00.867ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 4acc4057-9e37-454f-b1dd-7cbe37073be1
43682024-08-27T19:06:00.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = c25f6b80-75e7-48f6-ba74-63efe7b65a21 roles = RoleSet { roles: {} } uri = /metrics/producers
43692024-08-27T19:06:00.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = c25f6b80-75e7-48f6-ba74-63efe7b65a21 resource = Database result = Ok(()) uri = /metrics/producers
43702024-08-27T19:06:00.897ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 uri = http://[fd00:1122:3344:101::d]:12223/producers
43712024-08-27T19:06:00.897ZDEBGnexus: client response oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6daae152-2328-4042-9236-1d9d32548082", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43722024-08-27T19:06:00.897ZINFOnexus: assigned collector to new producer collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 file = nexus/src/app/oximeter.rs:125 producer_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
43732024-08-27T19:06:00.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64742 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = c25f6b80-75e7-48f6-ba74-63efe7b65a21 response_code = 201 uri = /metrics/producers
43742024-08-27T19:06:00.898ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "c25f6b80-75e7-48f6-ba74-63efe7b65a21", "content-length": "41", "date": "Tue, 27 Aug 2024 19:06:00 GMT"} })
43752024-08-27T19:06:00.900ZDEBGnexus (producer-registration-task): registered with nexus successfully
43762024-08-27T19:06:00.900ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
43772024-08-27T19:06:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ceec4b2c-b85c-45c6-9b1a-ad7709770016 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
43782024-08-27T19:06:00.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ceec4b2c-b85c-45c6-9b1a-ad7709770016 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
43792024-08-27T19:06:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = ceec4b2c-b85c-45c6-9b1a-ad7709770016 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
43802024-08-27T19:06:01.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a37daa81-71b7-4b77-930f-8d5228558245 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43812024-08-27T19:06:01.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a37daa81-71b7-4b77-930f-8d5228558245 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43822024-08-27T19:06:01.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a37daa81-71b7-4b77-930f-8d5228558245 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43832024-08-27T19:06:02.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74f54751-2e68-4120-9c67-285d9897250c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43842024-08-27T19:06:02.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74f54751-2e68-4120-9c67-285d9897250c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43852024-08-27T19:06:02.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74f54751-2e68-4120-9c67-285d9897250c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43862024-08-27T19:06:03.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8281a708-b82d-4336-bb83-765c4ede51fe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43872024-08-27T19:06:03.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8281a708-b82d-4336-bb83-765c4ede51fe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43882024-08-27T19:06:03.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8281a708-b82d-4336-bb83-765c4ede51fe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43892024-08-27T19:06:04.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9801a3fb-81fd-4331-a232-54f493356a11 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43902024-08-27T19:06:04.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9801a3fb-81fd-4331-a232-54f493356a11 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43912024-08-27T19:06:04.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9801a3fb-81fd-4331-a232-54f493356a11 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43922024-08-27T19:06:05.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d35650d9-4180-4b1f-8488-52499ef2f433 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43932024-08-27T19:06:05.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d35650d9-4180-4b1f-8488-52499ef2f433 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43942024-08-27T19:06:05.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d35650d9-4180-4b1f-8488-52499ef2f433 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43952024-08-27T19:06:06.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d40b0ab1-7ffd-4fa7-a717-f09937583b7b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43962024-08-27T19:06:06.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d40b0ab1-7ffd-4fa7-a717-f09937583b7b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43972024-08-27T19:06:06.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d40b0ab1-7ffd-4fa7-a717-f09937583b7b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43982024-08-27T19:06:07.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f75b17b3-4f17-4663-8704-eba9777c3a85 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
43992024-08-27T19:06:07.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f75b17b3-4f17-4663-8704-eba9777c3a85 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44002024-08-27T19:06:07.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f75b17b3-4f17-4663-8704-eba9777c3a85 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44012024-08-27T19:06:08.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ae92d48-52e3-4e22-8182-3ede52d4895e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44022024-08-27T19:06:08.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ae92d48-52e3-4e22-8182-3ede52d4895e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44032024-08-27T19:06:08.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ae92d48-52e3-4e22-8182-3ede52d4895e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44042024-08-27T19:06:09.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53160f1d-70c8-48a7-b539-4ec05cfe1e5f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44052024-08-27T19:06:09.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53160f1d-70c8-48a7-b539-4ec05cfe1e5f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44062024-08-27T19:06:09.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53160f1d-70c8-48a7-b539-4ec05cfe1e5f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44072024-08-27T19:06:10.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
44082024-08-27T19:06:10.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44092024-08-27T19:06:10.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
44102024-08-27T19:06:10.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44112024-08-27T19:06:10.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44122024-08-27T19:06:10.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44132024-08-27T19:06:10.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44142024-08-27T19:06:10.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44152024-08-27T19:06:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44162024-08-27T19:06:10.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.318048ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44172024-08-27T19:06:10.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44182024-08-27T19:06:10.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44192024-08-27T19:06:10.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44202024-08-27T19:06:10.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44212024-08-27T19:06:10.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44222024-08-27T19:06:10.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44232024-08-27T19:06:10.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
44242024-08-27T19:06:10.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44252024-08-27T19:06:10.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44262024-08-27T19:06:10.247ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
44272024-08-27T19:06:10.247ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.965845ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
44282024-08-27T19:06:10.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b9019e2-8e2d-434e-ab51-83876a837877 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44292024-08-27T19:06:10.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b9019e2-8e2d-434e-ab51-83876a837877 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44302024-08-27T19:06:10.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b9019e2-8e2d-434e-ab51-83876a837877 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44312024-08-27T19:06:10.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1016 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = f979ff33-240c-41d9-8ff7-3a762ab56d97 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
44322024-08-27T19:06:11.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee17dad3-7b43-4824-9c5a-848dd1ffaaf6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44332024-08-27T19:06:11.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee17dad3-7b43-4824-9c5a-848dd1ffaaf6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44342024-08-27T19:06:11.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee17dad3-7b43-4824-9c5a-848dd1ffaaf6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44352024-08-27T19:06:12.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 076c5037-1d4d-4b03-93c6-774fa58466cb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44362024-08-27T19:06:12.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 076c5037-1d4d-4b03-93c6-774fa58466cb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44372024-08-27T19:06:12.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 076c5037-1d4d-4b03-93c6-774fa58466cb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44382024-08-27T19:06:13.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af997f54-f82f-484f-95a3-64cb12fbaf13 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44392024-08-27T19:06:13.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af997f54-f82f-484f-95a3-64cb12fbaf13 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44402024-08-27T19:06:13.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af997f54-f82f-484f-95a3-64cb12fbaf13 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44412024-08-27T19:06:14.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 08c61cd4-6c99-488c-818b-ec53b96a87fd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44422024-08-27T19:06:14.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 08c61cd4-6c99-488c-818b-ec53b96a87fd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44432024-08-27T19:06:14.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 08c61cd4-6c99-488c-818b-ec53b96a87fd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44442024-08-27T19:06:15.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab70c797-f229-42ad-9feb-4e80251d47d7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44452024-08-27T19:06:15.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab70c797-f229-42ad-9feb-4e80251d47d7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44462024-08-27T19:06:15.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab70c797-f229-42ad-9feb-4e80251d47d7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44472024-08-27T19:06:16.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfc7e0b2-e19a-4230-bcad-5bb214e40745 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44482024-08-27T19:06:16.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfc7e0b2-e19a-4230-bcad-5bb214e40745 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44492024-08-27T19:06:16.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bfc7e0b2-e19a-4230-bcad-5bb214e40745 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44502024-08-27T19:06:17.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d25ec3e2-0b1e-43d9-94a1-094850fd2ef2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44512024-08-27T19:06:17.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d25ec3e2-0b1e-43d9-94a1-094850fd2ef2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44522024-08-27T19:06:17.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d25ec3e2-0b1e-43d9-94a1-094850fd2ef2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44532024-08-27T19:06:18.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51b1b307-6854-4554-8f99-64c63d646e24 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44542024-08-27T19:06:18.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51b1b307-6854-4554-8f99-64c63d646e24 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44552024-08-27T19:06:18.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51b1b307-6854-4554-8f99-64c63d646e24 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44562024-08-27T19:06:19.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ea78d18-420b-4613-a6e1-e51c5228dfcb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44572024-08-27T19:06:19.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ea78d18-420b-4613-a6e1-e51c5228dfcb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44582024-08-27T19:06:19.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6ea78d18-420b-4613-a6e1-e51c5228dfcb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44592024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
44602024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44612024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
44622024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44632024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44642024-08-27T19:06:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44652024-08-27T19:06:20.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44662024-08-27T19:06:20.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-08-27T19:06:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44682024-08-27T19:06:20.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.43105ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44692024-08-27T19:06:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44702024-08-27T19:06:20.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44712024-08-27T19:06:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44722024-08-27T19:06:20.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44732024-08-27T19:06:20.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44742024-08-27T19:06:20.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752024-08-27T19:06:20.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
44762024-08-27T19:06:20.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44772024-08-27T19:06:20.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44782024-08-27T19:06:20.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
44792024-08-27T19:06:20.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.886934ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
44802024-08-27T19:06:20.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c6b28a87-3566-4378-9eb5-97bd53b932bf roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44812024-08-27T19:06:20.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c6b28a87-3566-4378-9eb5-97bd53b932bf resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44822024-08-27T19:06:20.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c6b28a87-3566-4378-9eb5-97bd53b932bf response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44832024-08-27T19:06:20.885ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 632 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 7b60be81-287f-4622-8e39-e29a90ff0329 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
44842024-08-27T19:06:21.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ea941fe-cdee-4a57-9a53-6a9190315f95 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44852024-08-27T19:06:21.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ea941fe-cdee-4a57-9a53-6a9190315f95 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44862024-08-27T19:06:21.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1ea941fe-cdee-4a57-9a53-6a9190315f95 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44872024-08-27T19:06:22.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e9fa3e3c-481e-4be5-a23f-c1cdf220f613 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44882024-08-27T19:06:22.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e9fa3e3c-481e-4be5-a23f-c1cdf220f613 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44892024-08-27T19:06:22.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e9fa3e3c-481e-4be5-a23f-c1cdf220f613 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44902024-08-27T19:06:23.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c30a0890-166a-48c0-bdf9-2443f0736d97 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44912024-08-27T19:06:23.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c30a0890-166a-48c0-bdf9-2443f0736d97 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44922024-08-27T19:06:23.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c30a0890-166a-48c0-bdf9-2443f0736d97 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44932024-08-27T19:06:24.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b576db8-24e7-4563-9b5e-0871212dd35d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44942024-08-27T19:06:24.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b576db8-24e7-4563-9b5e-0871212dd35d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44952024-08-27T19:06:24.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b576db8-24e7-4563-9b5e-0871212dd35d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44962024-08-27T19:06:25.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2a1c105-1088-49b0-880e-b86c826982c9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44972024-08-27T19:06:25.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2a1c105-1088-49b0-880e-b86c826982c9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44982024-08-27T19:06:25.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2a1c105-1088-49b0-880e-b86c826982c9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
44992024-08-27T19:06:26.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6e157802-a37d-463a-b6fa-001b7325efb6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45002024-08-27T19:06:26.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6e157802-a37d-463a-b6fa-001b7325efb6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45012024-08-27T19:06:26.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6e157802-a37d-463a-b6fa-001b7325efb6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45022024-08-27T19:06:27.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f36bda0f-3338-48dd-b8de-f964d7fdb5fc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45032024-08-27T19:06:27.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f36bda0f-3338-48dd-b8de-f964d7fdb5fc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45042024-08-27T19:06:27.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f36bda0f-3338-48dd-b8de-f964d7fdb5fc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45052024-08-27T19:06:28.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baac7793-bc90-4c10-9a55-00023f5f6709 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45062024-08-27T19:06:28.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baac7793-bc90-4c10-9a55-00023f5f6709 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45072024-08-27T19:06:28.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baac7793-bc90-4c10-9a55-00023f5f6709 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45082024-08-27T19:06:29.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7cfb5314-4963-42b0-a283-148b9f1280f8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45092024-08-27T19:06:29.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7cfb5314-4963-42b0-a283-148b9f1280f8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45102024-08-27T19:06:29.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7cfb5314-4963-42b0-a283-148b9f1280f8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
45112024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
45122024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
45132024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
45142024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
45152024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45162024-08-27T19:06:30.235ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
45172024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
45182024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.87\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
45192024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
45202024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45212024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
45222024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45232024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
45242024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
45252024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45262024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45272024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45282024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
45292024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45302024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
45312024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
45322024-08-27T19:06:30.235ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45332024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
45342024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45352024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45362024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45372024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
45382024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
45392024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45402024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45412024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
45422024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45432024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
45442024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45452024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
45462024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45472024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
45482024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45492024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
45502024-08-27T19:06:30.235ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:56:30.235365214 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45512024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45522024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
45532024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
45542024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45552024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45562024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45572024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45582024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45592024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45602024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45612024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45622024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45632024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45642024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45652024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45662024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45672024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45682024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45692024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45702024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45712024-08-27T19:06:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45722024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
45732024-08-27T19:06:30.236ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
45742024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
45752024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45762024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45772024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
45782024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
45792024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45802024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45812024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
45822024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45832024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
45842024-08-27T19:06:30.236ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
45852024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45862024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45872024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45882024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45892024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45902024-08-27T19:06:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45912024-08-27T19:06:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45922024-08-27T19:06:30.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 885429781 } })
45932024-08-27T19:06:30.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45942024-08-27T19:06:30.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 885643985 } })
45952024-08-27T19:06:30.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45962024-08-27T19:06:30.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 885709277 } })
45972024-08-27T19:06:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45982024-08-27T19:06:30.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45992024-08-27T19:06:30.238ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.082203ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46002024-08-27T19:06:30.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46012024-08-27T19:06:30.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46022024-08-27T19:06:30.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46032024-08-27T19:06:30.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
46042024-08-27T19:06:30.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46052024-08-27T19:06:30.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062024-08-27T19:06:30.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072024-08-27T19:06:30.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46082024-08-27T19:06:30.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.941462ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46092024-08-27T19:06:30.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
46102024-08-27T19:06:30.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.029423ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
46112024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46122024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46132024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46142024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46152024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46162024-08-27T19:06:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46172024-08-27T19:06:30.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46182024-08-27T19:06:30.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46192024-08-27T19:06:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46202024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46212024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46222024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46232024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46242024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46252024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46262024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46272024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46282024-08-27T19:06:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46292024-08-27T19:06:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46302024-08-27T19:06:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46312024-08-27T19:06:30.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46322024-08-27T19:06:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46332024-08-27T19:06:30.251ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46342024-08-27T19:06:30.251ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46352024-08-27T19:06:30.251ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46362024-08-27T19:06:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46372024-08-27T19:06:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46382024-08-27T19:06:30.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46392024-08-27T19:06:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46402024-08-27T19:06:30.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46412024-08-27T19:06:30.254ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:56:30.235365214 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46422024-08-27T19:06:30.254ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.508358ms iteration = 5 status = {"expiration":"2024-08-27T18:56:30.235365214Z","pruned":[]}
46432024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46442024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46452024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46462024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46472024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46482024-08-27T19:06:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46492024-08-27T19:06:30.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.180792ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46502024-08-27T19:06:30.256ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.049899ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
46512024-08-27T19:06:30.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46522024-08-27T19:06:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46532024-08-27T19:06:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46542024-08-27T19:06:30.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552024-08-27T19:06:30.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 905967780 } })
46562024-08-27T19:06:30.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46572024-08-27T19:06:30.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46582024-08-27T19:06:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46592024-08-27T19:06:30.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46602024-08-27T19:06:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46612024-08-27T19:06:30.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
46622024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 24.594002ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
46632024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46642024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46652024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46662024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46672024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46682024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46692024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46702024-08-27T19:06:30.261ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46712024-08-27T19:06:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.613733ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46722024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
46732024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46742024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46752024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46762024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46772024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46782024-08-27T19:06:30.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46792024-08-27T19:06:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46802024-08-27T19:06:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46812024-08-27T19:06:30.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-08-27T19:06:30.264ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
46832024-08-27T19:06:30.264ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
46842024-08-27T19:06:30.264ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
46852024-08-27T19:06:30.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46862024-08-27T19:06:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46872024-08-27T19:06:30.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46882024-08-27T19:06:30.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46892024-08-27T19:06:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46902024-08-27T19:06:30.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46912024-08-27T19:06:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46922024-08-27T19:06:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46932024-08-27T19:06:30.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942024-08-27T19:06:30.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46952024-08-27T19:06:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46962024-08-27T19:06:30.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46972024-08-27T19:06:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46982024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46992024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47002024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47012024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47022024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47032024-08-27T19:06:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47042024-08-27T19:06:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 36.121977ms iteration = 11 status = {"physical_disks_added":0}
47052024-08-27T19:06:30.271ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
47062024-08-27T19:06:30.271ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
47072024-08-27T19:06:30.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47082024-08-27T19:06:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47092024-08-27T19:06:30.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47102024-08-27T19:06:30.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112024-08-27T19:06:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
47122024-08-27T19:06:30.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47132024-08-27T19:06:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47142024-08-27T19:06:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47152024-08-27T19:06:30.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47162024-08-27T19:06:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47172024-08-27T19:06:30.276ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 924884816 } })
47182024-08-27T19:06:30.277ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
47192024-08-27T19:06:30.281ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
47202024-08-27T19:06:30.281ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.270955ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
47212024-08-27T19:06:30.282ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47222024-08-27T19:06:30.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47232024-08-27T19:06:30.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.410607ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47242024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47252024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47262024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
47272024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47282024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
47292024-08-27T19:06:30.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 50.220995ms iteration = 5 status = {"generation":2}
47302024-08-27T19:06:30.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.512122ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
47312024-08-27T19:06:30.289ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
47322024-08-27T19:06:30.289ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47332024-08-27T19:06:30.289ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
47342024-08-27T19:06:30.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 54.110434ms iteration = 5 status = {"generation":1}
47352024-08-27T19:06:30.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47362024-08-27T19:06:30.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47372024-08-27T19:06:30.297ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47382024-08-27T19:06:30.297ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47392024-08-27T19:06:30.297ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 62.332612ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47402024-08-27T19:06:30.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47412024-08-27T19:06:30.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47422024-08-27T19:06:30.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47432024-08-27T19:06:30.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47442024-08-27T19:06:30.300ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
47452024-08-27T19:06:30.300ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47462024-08-27T19:06:30.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47472024-08-27T19:06:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47482024-08-27T19:06:30.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492024-08-27T19:06:30.305ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
47502024-08-27T19:06:30.305ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
47512024-08-27T19:06:30.305ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.231033ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
47522024-08-27T19:06:30.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
47532024-08-27T19:06:30.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47542024-08-27T19:06:30.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47552024-08-27T19:06:30.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47562024-08-27T19:06:30.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47572024-08-27T19:06:30.307ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.537821ms iteration = 9 status = 0
47582024-08-27T19:06:30.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47592024-08-27T19:06:30.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47602024-08-27T19:06:30.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47612024-08-27T19:06:30.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47622024-08-27T19:06:30.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47632024-08-27T19:06:30.310ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
47642024-08-27T19:06:30.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 74.177444ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47652024-08-27T19:06:30.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47662024-08-27T19:06:30.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47672024-08-27T19:06:30.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47682024-08-27T19:06:30.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-08-27T19:06:30.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47702024-08-27T19:06:30.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712024-08-27T19:06:30.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47722024-08-27T19:06:30.328ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
47732024-08-27T19:06:30.328ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47742024-08-27T19:06:30.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.662992ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
47752024-08-27T19:06:30.336ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
47762024-08-27T19:06:30.337ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 101.703615ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47772024-08-27T19:06:30.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
47782024-08-27T19:06:30.506ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47792024-08-27T19:06:30.507ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc7271b2-e3d7-4a1a-8695-f66acda1dc46", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
47802024-08-27T19:06:30.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47812024-08-27T19:06:30.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
47822024-08-27T19:06:30.521ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47832024-08-27T19:06:30.521ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bcdeba54-389f-4791-9d4e-bbae5eda4352", "content-length": "691", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
47842024-08-27T19:06:30.521ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47852024-08-27T19:06:30.521ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47862024-08-27T19:06:30.521ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47872024-08-27T19:06:30.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.468177ms iteration = 9 status = {}
47882024-08-27T19:06:30.523ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47892024-08-27T19:06:30.526ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47902024-08-27T19:06:30.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47912024-08-27T19:06:30.528ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47922024-08-27T19:06:30.528ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7328d80-f453-4c83-adce-04197dfdf72e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
47932024-08-27T19:06:30.528ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47942024-08-27T19:06:30.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47952024-08-27T19:06:30.558ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47962024-08-27T19:06:30.558ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf521e3c-cebe-46a1-839c-ec2f16538eb4", "content-length": "372", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
47972024-08-27T19:06:30.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47982024-08-27T19:06:30.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47992024-08-27T19:06:30.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48002024-08-27T19:06:30.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48012024-08-27T19:06:30.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48022024-08-27T19:06:30.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48032024-08-27T19:06:30.566ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48042024-08-27T19:06:30.567ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2f5b332a-ce3a-43a6-94e2-4d9e72ca0da3", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
48052024-08-27T19:06:30.568ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.924734ms iteration = 9 status = {}
48062024-08-27T19:06:30.607ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
48072024-08-27T19:06:30.607ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48082024-08-27T19:06:30.608ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b56c1ad-ccf6-43be-bcd4-662ce6da8032", "content-length": "26", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
48092024-08-27T19:06:30.608ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48102024-08-27T19:06:30.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48112024-08-27T19:06:30.758ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 522.910773ms iteration = 9 status = {}
48122024-08-27T19:06:30.765ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48132024-08-27T19:06:30.765ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ae19b47-fade-4a4e-904e-b58b4a0b914c", "content-length": "1", "date": "Tue, 27 Aug 2024 19:06:29 GMT"} })
48142024-08-27T19:06:30.766ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48152024-08-27T19:06:30.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48162024-08-27T19:06:30.768ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 533.160272ms iteration = 9 status = null
48172024-08-27T19:06:30.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48182024-08-27T19:06:30.786ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48192024-08-27T19:06:30.787ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1977a710-30d3-482e-b2ae-6a43372160ce", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48202024-08-27T19:06:30.787ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48212024-08-27T19:06:30.788ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e007a3b4-0630-4fff-a221-9cb1b27855c8", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48222024-08-27T19:06:30.788ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48232024-08-27T19:06:30.790ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48242024-08-27T19:06:30.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 554.682201ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48252024-08-27T19:06:30.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48262024-08-27T19:06:30.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c28b35f8-79f3-4d2a-907e-8f6fbc4150ec", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48272024-08-27T19:06:30.850ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48282024-08-27T19:06:30.851ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c6ca7401-044d-40e7-a18d-2351eef18dd6", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48292024-08-27T19:06:30.851ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48302024-08-27T19:06:30.853ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "30c5b292-0bfc-4bf8-8e8f-6531e5de4347", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48312024-08-27T19:06:30.853ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48322024-08-27T19:06:30.855ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48332024-08-27T19:06:30.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 620.640848ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48342024-08-27T19:06:30.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48352024-08-27T19:06:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48362024-08-27T19:06:30.873ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
48372024-08-27T19:06:30.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48382024-08-27T19:06:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48392024-08-27T19:06:30.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48402024-08-27T19:06:30.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10802617-899c-4911-82cf-603b19b056f9", "content-length": "121", "date": "Tue, 27 Aug 2024 19:06:29 GMT"} })
48412024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
48422024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
48432024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48442024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48452024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
48462024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
48472024-08-27T19:06:30.881ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
48482024-08-27T19:06:30.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48492024-08-27T19:06:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502024-08-27T19:06:30.885ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1085 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 1bf9152b-a279-4f7a-aa4b-5a12a1fb2dc8 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
48512024-08-27T19:06:30.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48522024-08-27T19:06:30.929ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f5cd642-caf2-4eee-a38a-2eb67d75a283", "content-length": "2", "date": "Tue, 27 Aug 2024 19:06:29 GMT"} })
48532024-08-27T19:06:30.929ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48542024-08-27T19:06:30.929ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c66acdb-c6b9-4916-a4d5-22a75040bc92", "content-length": "52", "date": "Tue, 27 Aug 2024 19:06:29 GMT"} })
48552024-08-27T19:06:30.929ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
48562024-08-27T19:06:30.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48572024-08-27T19:06:30.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6dded536-fd38-4326-90a5-29e5750e2103 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48582024-08-27T19:06:30.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6dded536-fd38-4326-90a5-29e5750e2103 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48592024-08-27T19:06:30.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6dded536-fd38-4326-90a5-29e5750e2103 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48602024-08-27T19:06:30.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 12684ec2-eed2-46ff-93e9-5737586f5009 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
48612024-08-27T19:06:30.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 12684ec2-eed2-46ff-93e9-5737586f5009 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
48622024-08-27T19:06:30.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 12684ec2-eed2-46ff-93e9-5737586f5009 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
48632024-08-27T19:06:31.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8bcbf895-b774-45e7-802b-e8cdcf6ddb78", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
48642024-08-27T19:06:31.018ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
48652024-08-27T19:06:31.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48662024-08-27T19:06:31.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2821684c-6625-445a-aa06-bff613b18337", "content-length": "667", "date": "Tue, 27 Aug 2024 19:06:30 GMT"} })
48672024-08-27T19:06:31.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48682024-08-27T19:06:31.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48692024-08-27T19:06:31.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48702024-08-27T19:06:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48712024-08-27T19:06:31.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48722024-08-27T19:06:31.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48732024-08-27T19:06:31.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48742024-08-27T19:06:31.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48752024-08-27T19:06:31.033ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 798.215301ms iteration = 9 status = {}
48762024-08-27T19:06:32.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4aff600e-b830-49d1-aa1e-3b9e052b1d9e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48772024-08-27T19:06:32.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4aff600e-b830-49d1-aa1e-3b9e052b1d9e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48782024-08-27T19:06:32.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4aff600e-b830-49d1-aa1e-3b9e052b1d9e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48792024-08-27T19:06:33.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22cb46b8-44f1-439d-810a-4d50d72d8557 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48802024-08-27T19:06:33.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22cb46b8-44f1-439d-810a-4d50d72d8557 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48812024-08-27T19:06:33.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22cb46b8-44f1-439d-810a-4d50d72d8557 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48822024-08-27T19:06:34.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b0bdc4f-fb5f-40b8-9f1f-bf800f792fd0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48832024-08-27T19:06:34.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b0bdc4f-fb5f-40b8-9f1f-bf800f792fd0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48842024-08-27T19:06:34.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8b0bdc4f-fb5f-40b8-9f1f-bf800f792fd0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48852024-08-27T19:06:35.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 488509fc-b30e-492c-84ff-dc36be33b359 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48862024-08-27T19:06:35.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 488509fc-b30e-492c-84ff-dc36be33b359 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48872024-08-27T19:06:35.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 488509fc-b30e-492c-84ff-dc36be33b359 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48882024-08-27T19:06:36.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46092b4a-c750-4c25-a165-d7865a37e981 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48892024-08-27T19:06:36.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46092b4a-c750-4c25-a165-d7865a37e981 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48902024-08-27T19:06:36.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46092b4a-c750-4c25-a165-d7865a37e981 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48912024-08-27T19:06:37.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6e5bfbf-10ab-4143-9949-b48f41c3176a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48922024-08-27T19:06:37.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6e5bfbf-10ab-4143-9949-b48f41c3176a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48932024-08-27T19:06:37.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e6e5bfbf-10ab-4143-9949-b48f41c3176a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48942024-08-27T19:06:38.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 32f60ee9-8880-4d09-aa30-8b2ff9d61fa3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48952024-08-27T19:06:38.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 32f60ee9-8880-4d09-aa30-8b2ff9d61fa3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48962024-08-27T19:06:38.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 32f60ee9-8880-4d09-aa30-8b2ff9d61fa3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48972024-08-27T19:06:39.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dfc666e-ba36-441c-b14c-75d06a72c07d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48982024-08-27T19:06:39.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dfc666e-ba36-441c-b14c-75d06a72c07d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
48992024-08-27T19:06:39.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dfc666e-ba36-441c-b14c-75d06a72c07d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49002024-08-27T19:06:40.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 60b44e32-3208-4339-90c3-4d738d9b1ff8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49012024-08-27T19:06:40.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 60b44e32-3208-4339-90c3-4d738d9b1ff8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49022024-08-27T19:06:40.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 60b44e32-3208-4339-90c3-4d738d9b1ff8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49032024-08-27T19:06:40.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
49042024-08-27T19:06:40.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
49052024-08-27T19:06:40.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49062024-08-27T19:06:40.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49072024-08-27T19:06:40.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49082024-08-27T19:06:40.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49092024-08-27T19:06:40.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49102024-08-27T19:06:40.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112024-08-27T19:06:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49122024-08-27T19:06:40.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.484621ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49132024-08-27T19:06:40.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49142024-08-27T19:06:40.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49152024-08-27T19:06:40.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49162024-08-27T19:06:40.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49172024-08-27T19:06:40.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49182024-08-27T19:06:40.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49192024-08-27T19:06:40.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
49202024-08-27T19:06:40.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49212024-08-27T19:06:40.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49222024-08-27T19:06:40.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
49232024-08-27T19:06:40.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.920644ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
49242024-08-27T19:06:40.885ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 708 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 454e1780-927c-457e-8661-59e29465dde8 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
49252024-08-27T19:06:41.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc0d9b1b-1389-43ae-8952-9a9d9c83f783 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49262024-08-27T19:06:41.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc0d9b1b-1389-43ae-8952-9a9d9c83f783 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49272024-08-27T19:06:41.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc0d9b1b-1389-43ae-8952-9a9d9c83f783 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49282024-08-27T19:06:42.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ad259ade-11da-4cd0-a11f-f98c8dfca79f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49292024-08-27T19:06:42.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ad259ade-11da-4cd0-a11f-f98c8dfca79f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49302024-08-27T19:06:42.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ad259ade-11da-4cd0-a11f-f98c8dfca79f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49312024-08-27T19:06:43.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c95c3631-add4-4723-afa9-5c6dd7420d00 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49322024-08-27T19:06:43.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c95c3631-add4-4723-afa9-5c6dd7420d00 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49332024-08-27T19:06:43.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c95c3631-add4-4723-afa9-5c6dd7420d00 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49342024-08-27T19:06:44.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 86a8a0a9-3ff9-4052-9dc2-0fca8e38a86a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49352024-08-27T19:06:44.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 86a8a0a9-3ff9-4052-9dc2-0fca8e38a86a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49362024-08-27T19:06:44.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 86a8a0a9-3ff9-4052-9dc2-0fca8e38a86a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49372024-08-27T19:06:45.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e43aa68d-679c-4b85-870e-07ebf3e68f67 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49382024-08-27T19:06:45.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e43aa68d-679c-4b85-870e-07ebf3e68f67 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49392024-08-27T19:06:45.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e43aa68d-679c-4b85-870e-07ebf3e68f67 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49402024-08-27T19:06:46.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dc31a61-66f0-4ab9-beff-415d665e1dea roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49412024-08-27T19:06:46.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dc31a61-66f0-4ab9-beff-415d665e1dea resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49422024-08-27T19:06:46.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2dc31a61-66f0-4ab9-beff-415d665e1dea response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49432024-08-27T19:06:47.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8ac04d64-bf30-4fc6-b768-67132a885e8d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49442024-08-27T19:06:47.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8ac04d64-bf30-4fc6-b768-67132a885e8d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49452024-08-27T19:06:47.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8ac04d64-bf30-4fc6-b768-67132a885e8d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49462024-08-27T19:06:48.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 30456976-fbc9-40ce-bc8c-e75415747c1d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49472024-08-27T19:06:48.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 30456976-fbc9-40ce-bc8c-e75415747c1d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49482024-08-27T19:06:48.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 30456976-fbc9-40ce-bc8c-e75415747c1d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49492024-08-27T19:06:49.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb9dfc07-2435-4f4c-beb2-8ca4b4beefb2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49502024-08-27T19:06:49.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb9dfc07-2435-4f4c-beb2-8ca4b4beefb2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49512024-08-27T19:06:49.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb9dfc07-2435-4f4c-beb2-8ca4b4beefb2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49522024-08-27T19:06:50.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
49532024-08-27T19:06:50.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
49542024-08-27T19:06:50.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49552024-08-27T19:06:50.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49562024-08-27T19:06:50.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49572024-08-27T19:06:50.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49582024-08-27T19:06:50.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-08-27T19:06:50.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49602024-08-27T19:06:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49612024-08-27T19:06:50.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.245327ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49622024-08-27T19:06:50.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49632024-08-27T19:06:50.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49642024-08-27T19:06:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49652024-08-27T19:06:50.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49662024-08-27T19:06:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49672024-08-27T19:06:50.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49682024-08-27T19:06:50.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
49692024-08-27T19:06:50.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49702024-08-27T19:06:50.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49712024-08-27T19:06:50.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
49722024-08-27T19:06:50.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.159398ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
49732024-08-27T19:06:50.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7f36420b-d331-4843-a57d-769221526aa2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49742024-08-27T19:06:50.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7f36420b-d331-4843-a57d-769221526aa2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49752024-08-27T19:06:50.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7f36420b-d331-4843-a57d-769221526aa2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49762024-08-27T19:06:50.885ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 688 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 77eef13b-ddd6-4304-a81f-a8773b2b21e2 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
49772024-08-27T19:06:51.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 12b6819b-f50c-4afa-9fc4-91244ff2d55e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49782024-08-27T19:06:51.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 12b6819b-f50c-4afa-9fc4-91244ff2d55e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49792024-08-27T19:06:51.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 12b6819b-f50c-4afa-9fc4-91244ff2d55e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49802024-08-27T19:06:52.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 068c034a-c8f4-4343-9320-7f08f40960e7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49812024-08-27T19:06:52.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 068c034a-c8f4-4343-9320-7f08f40960e7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49822024-08-27T19:06:52.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 068c034a-c8f4-4343-9320-7f08f40960e7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49832024-08-27T19:06:53.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd869441-37e8-4296-8d3c-0b364cc34e38 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49842024-08-27T19:06:53.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd869441-37e8-4296-8d3c-0b364cc34e38 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49852024-08-27T19:06:53.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd869441-37e8-4296-8d3c-0b364cc34e38 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49862024-08-27T19:06:54.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a86ccc93-88a2-4c2e-b51d-027ba3a33012 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49872024-08-27T19:06:54.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a86ccc93-88a2-4c2e-b51d-027ba3a33012 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49882024-08-27T19:06:54.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a86ccc93-88a2-4c2e-b51d-027ba3a33012 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49892024-08-27T19:06:55.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd59bd69-f0ae-4f99-b49d-b4282478e1ea roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49902024-08-27T19:06:55.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd59bd69-f0ae-4f99-b49d-b4282478e1ea resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49912024-08-27T19:06:55.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cd59bd69-f0ae-4f99-b49d-b4282478e1ea response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49922024-08-27T19:06:56.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66869f19-5e90-4852-9f6c-e21d43cb7564 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49932024-08-27T19:06:56.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66869f19-5e90-4852-9f6c-e21d43cb7564 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49942024-08-27T19:06:56.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66869f19-5e90-4852-9f6c-e21d43cb7564 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49952024-08-27T19:06:57.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 887abc95-3676-4b7c-b316-567b8cb33d72 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49962024-08-27T19:06:57.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 887abc95-3676-4b7c-b316-567b8cb33d72 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49972024-08-27T19:06:57.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 887abc95-3676-4b7c-b316-567b8cb33d72 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49982024-08-27T19:06:58.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc65947-5bb5-4755-8ff6-56cd73b689df roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
49992024-08-27T19:06:58.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc65947-5bb5-4755-8ff6-56cd73b689df resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
50002024-08-27T19:06:58.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3bc65947-5bb5-4755-8ff6-56cd73b689df response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
50012024-08-27T19:06:59.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76d61f57-d109-4d9c-afde-014fc93f20dd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
50022024-08-27T19:06:59.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76d61f57-d109-4d9c-afde-014fc93f20dd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
50032024-08-27T19:06:59.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76d61f57-d109-4d9c-afde-014fc93f20dd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
50042024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
50052024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
50062024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50072024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
50082024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50092024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50102024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50112024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
50122024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50132024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
50142024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
50152024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50162024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
50172024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50182024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50192024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
50202024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50212024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
50222024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
50232024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50242024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
50252024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50262024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
50272024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50282024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50292024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50302024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50312024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50322024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50332024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50342024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50352024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50362024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50372024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50382024-08-27T19:07:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50392024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
50402024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50412024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
50422024-08-27T19:07:00.233ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
50432024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50442024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
50452024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
50462024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50472024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50482024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50492024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50502024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50512024-08-27T19:07:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50522024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50532024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50542024-08-27T19:07:00.234ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50552024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50562024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50572024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50592024-08-27T19:07:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50602024-08-27T19:07:00.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612024-08-27T19:07:00.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622024-08-27T19:07:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.505572ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50632024-08-27T19:07:00.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 887638070 } })
50642024-08-27T19:07:00.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
50652024-08-27T19:07:00.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.294547ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50662024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50672024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50682024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50692024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50702024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50712024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50722024-08-27T19:07:00.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50732024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50742024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50752024-08-27T19:07:00.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 889956767 } })
50762024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50772024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50782024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50792024-08-27T19:07:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50802024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50812024-08-27T19:07:00.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
50822024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50832024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50842024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50852024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.459672ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50862024-08-27T19:07:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50872024-08-27T19:07:00.240ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
50882024-08-27T19:07:00.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.672706ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50892024-08-27T19:07:00.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.119645ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
50902024-08-27T19:07:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50912024-08-27T19:07:00.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50922024-08-27T19:07:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50932024-08-27T19:07:00.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50942024-08-27T19:07:00.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50952024-08-27T19:07:00.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50962024-08-27T19:07:00.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 893193703 } })
50972024-08-27T19:07:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50982024-08-27T19:07:00.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
50992024-08-27T19:07:00.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51002024-08-27T19:07:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51012024-08-27T19:07:00.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51022024-08-27T19:07:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51032024-08-27T19:07:00.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-08-27T19:07:00.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-08-27T19:07:00.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51062024-08-27T19:07:00.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51072024-08-27T19:07:00.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51082024-08-27T19:07:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51092024-08-27T19:07:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51102024-08-27T19:07:00.245ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51112024-08-27T19:07:00.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.983565ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51122024-08-27T19:07:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51132024-08-27T19:07:00.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51142024-08-27T19:07:00.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51152024-08-27T19:07:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51162024-08-27T19:07:00.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51172024-08-27T19:07:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51182024-08-27T19:07:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
51192024-08-27T19:07:00.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51202024-08-27T19:07:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51212024-08-27T19:07:00.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51222024-08-27T19:07:00.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51232024-08-27T19:07:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51242024-08-27T19:07:00.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
51252024-08-27T19:07:00.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.822695ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
51262024-08-27T19:07:00.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51272024-08-27T19:07:00.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51282024-08-27T19:07:00.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292024-08-27T19:07:00.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51302024-08-27T19:07:00.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51312024-08-27T19:07:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51322024-08-27T19:07:00.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51332024-08-27T19:07:00.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51342024-08-27T19:07:00.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51352024-08-27T19:07:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51362024-08-27T19:07:00.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51372024-08-27T19:07:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51382024-08-27T19:07:00.275ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
51392024-08-27T19:07:00.275ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51402024-08-27T19:07:00.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 42.928607ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
51412024-08-27T19:07:00.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51422024-08-27T19:07:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51432024-08-27T19:07:00.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442024-08-27T19:07:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
51452024-08-27T19:07:00.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51462024-08-27T19:07:00.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51472024-08-27T19:07:00.281ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.644433ms iteration = 10 status = 0
51482024-08-27T19:07:00.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.622212ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
51492024-08-27T19:07:00.292ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 60.28232ms iteration = 12 status = {"physical_disks_added":0}
51502024-08-27T19:07:00.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51512024-08-27T19:07:00.332ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51522024-08-27T19:07:00.333ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49f9bafe-a0cd-45dd-a7a7-0564b23dab6b", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51532024-08-27T19:07:00.333ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51542024-08-27T19:07:00.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51552024-08-27T19:07:00.360ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
51562024-08-27T19:07:00.360ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51572024-08-27T19:07:00.360ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd785ac4-da6b-49c5-836f-4642a2c7039d", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51582024-08-27T19:07:00.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51592024-08-27T19:07:00.362ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
51602024-08-27T19:07:00.383ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51612024-08-27T19:07:00.383ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51622024-08-27T19:07:00.383ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aee6d0a7-7740-44aa-83aa-256d59b95789", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51632024-08-27T19:07:00.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51642024-08-27T19:07:00.384ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51652024-08-27T19:07:00.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51662024-08-27T19:07:00.385ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d017a1a-13c3-4712-bbbe-7d057d8b0f23", "content-length": "691", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51672024-08-27T19:07:00.385ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51682024-08-27T19:07:00.385ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51692024-08-27T19:07:00.385ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51702024-08-27T19:07:00.387ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 154.970903ms iteration = 10 status = {}
51712024-08-27T19:07:00.404ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51722024-08-27T19:07:00.404ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fe7e7c2e-6812-45a2-ba90-bc8fa2271c4e", "content-length": "372", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51732024-08-27T19:07:00.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51742024-08-27T19:07:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51752024-08-27T19:07:00.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51762024-08-27T19:07:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51772024-08-27T19:07:00.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51782024-08-27T19:07:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51792024-08-27T19:07:00.411ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51802024-08-27T19:07:00.411ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "faea3c82-2936-4df6-95b9-8c21bd715a9f", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51812024-08-27T19:07:00.413ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 179.712868ms iteration = 10 status = {}
51822024-08-27T19:07:00.438ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.985754ms iteration = 10 status = {}
51832024-08-27T19:07:00.458ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51842024-08-27T19:07:00.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0f085c9-8fff-466e-b925-7500c8308e00", "content-length": "1", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51852024-08-27T19:07:00.459ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51862024-08-27T19:07:00.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51872024-08-27T19:07:00.461ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.937463ms iteration = 10 status = null
51882024-08-27T19:07:00.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51892024-08-27T19:07:00.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51902024-08-27T19:07:00.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
51912024-08-27T19:07:00.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51922024-08-27T19:07:00.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51932024-08-27T19:07:00.526ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51942024-08-27T19:07:00.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69eb5e88-b3e3-4ca5-9f03-6601e6b993c4", "content-length": "121", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
51952024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51962024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
51972024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51982024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51992024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
52002024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
52012024-08-27T19:07:00.527ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
52022024-08-27T19:07:00.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52032024-08-27T19:07:00.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52042024-08-27T19:07:00.529ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52052024-08-27T19:07:00.529ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0dbfbe5-8161-40cb-87f0-b6c72cbc50a8", "content-length": "2", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
52062024-08-27T19:07:00.529ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52072024-08-27T19:07:00.529ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1736d2ad-af3c-4f99-873c-265a535ab9eb", "content-length": "52", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
52082024-08-27T19:07:00.529ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
52092024-08-27T19:07:00.529ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52102024-08-27T19:07:00.630ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "402c1ed8-a683-453b-b3ac-9969f79f31e9", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
52112024-08-27T19:07:00.630ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
52122024-08-27T19:07:00.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52132024-08-27T19:07:00.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e31fadc3-4569-4aec-b924-22879e7261b4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52142024-08-27T19:07:00.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e31fadc3-4569-4aec-b924-22879e7261b4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52152024-08-27T19:07:00.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e31fadc3-4569-4aec-b924-22879e7261b4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52162024-08-27T19:07:00.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aeb5eb00-ae77-4f42-9c3a-81e0276cc215", "content-length": "667", "date": "Tue, 27 Aug 2024 19:07:00 GMT"} })
52172024-08-27T19:07:00.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52182024-08-27T19:07:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52192024-08-27T19:07:00.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52202024-08-27T19:07:00.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52212024-08-27T19:07:00.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52222024-08-27T19:07:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52232024-08-27T19:07:00.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52242024-08-27T19:07:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52252024-08-27T19:07:00.651ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 419.261177ms iteration = 10 status = {}
52262024-08-27T19:07:00.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 506 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 951f66b2-bffd-4c68-b8ca-964fe0e6302e response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
52272024-08-27T19:07:01.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 977a51a3-2942-4602-bc84-a5c09b23cf8c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
52282024-08-27T19:07:01.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 977a51a3-2942-4602-bc84-a5c09b23cf8c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
52292024-08-27T19:07:01.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 977a51a3-2942-4602-bc84-a5c09b23cf8c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
52302024-08-27T19:07:01.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 503d6ad8-c199-4a24-9fae-9e207ddb1aa0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52312024-08-27T19:07:01.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 503d6ad8-c199-4a24-9fae-9e207ddb1aa0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52322024-08-27T19:07:01.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 503d6ad8-c199-4a24-9fae-9e207ddb1aa0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52332024-08-27T19:07:02.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35f6763e-def8-449e-87e2-364740f0942e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52342024-08-27T19:07:02.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35f6763e-def8-449e-87e2-364740f0942e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52352024-08-27T19:07:02.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 35f6763e-def8-449e-87e2-364740f0942e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52362024-08-27T19:07:03.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 635ce7c5-973a-4ce3-95ab-e17b95a7e4a2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52372024-08-27T19:07:03.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 635ce7c5-973a-4ce3-95ab-e17b95a7e4a2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52382024-08-27T19:07:03.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 635ce7c5-973a-4ce3-95ab-e17b95a7e4a2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52392024-08-27T19:07:04.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9614ec10-771f-4f47-99b9-133583216e46 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52402024-08-27T19:07:04.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9614ec10-771f-4f47-99b9-133583216e46 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52412024-08-27T19:07:04.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9614ec10-771f-4f47-99b9-133583216e46 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52422024-08-27T19:07:05.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec4a3592-219d-4d4d-9110-7a777ed5c07a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52432024-08-27T19:07:05.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec4a3592-219d-4d4d-9110-7a777ed5c07a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52442024-08-27T19:07:05.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ec4a3592-219d-4d4d-9110-7a777ed5c07a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52452024-08-27T19:07:06.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a8eb062-5c41-40d4-8cf9-c6a7c12e20e9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52462024-08-27T19:07:06.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a8eb062-5c41-40d4-8cf9-c6a7c12e20e9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52472024-08-27T19:07:06.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a8eb062-5c41-40d4-8cf9-c6a7c12e20e9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52482024-08-27T19:07:07.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a4c8e8-5faa-4b4b-a135-803ab8759e1a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52492024-08-27T19:07:07.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a4c8e8-5faa-4b4b-a135-803ab8759e1a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52502024-08-27T19:07:07.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0a4c8e8-5faa-4b4b-a135-803ab8759e1a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52512024-08-27T19:07:08.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 538fee0f-d697-4a28-80d0-6f77c124cd9f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52522024-08-27T19:07:08.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 538fee0f-d697-4a28-80d0-6f77c124cd9f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52532024-08-27T19:07:08.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 538fee0f-d697-4a28-80d0-6f77c124cd9f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52542024-08-27T19:07:09.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 04ab6a82-41a7-4dc6-84ab-f019342ba47c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52552024-08-27T19:07:09.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 04ab6a82-41a7-4dc6-84ab-f019342ba47c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52562024-08-27T19:07:09.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 04ab6a82-41a7-4dc6-84ab-f019342ba47c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52572024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
52582024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
52592024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52602024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52612024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52622024-08-27T19:07:10.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52632024-08-27T19:07:10.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52642024-08-27T19:07:10.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52652024-08-27T19:07:10.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52662024-08-27T19:07:10.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.301157ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52672024-08-27T19:07:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52682024-08-27T19:07:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52692024-08-27T19:07:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52702024-08-27T19:07:10.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52712024-08-27T19:07:10.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-08-27T19:07:10.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-08-27T19:07:10.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
52742024-08-27T19:07:10.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52752024-08-27T19:07:10.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52762024-08-27T19:07:10.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
52772024-08-27T19:07:10.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.614788ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
52782024-08-27T19:07:10.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c713025e-07f9-4465-a6f8-d840abf5bc60 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52792024-08-27T19:07:10.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c713025e-07f9-4465-a6f8-d840abf5bc60 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52802024-08-27T19:07:10.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c713025e-07f9-4465-a6f8-d840abf5bc60 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52812024-08-27T19:07:10.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 463 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = bdf7bda6-b315-48ff-b490-1a3ef069db20 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
52822024-08-27T19:07:11.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97de5ef9-fd11-474a-bb4b-5588b34211a4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52832024-08-27T19:07:11.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97de5ef9-fd11-474a-bb4b-5588b34211a4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52842024-08-27T19:07:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97de5ef9-fd11-474a-bb4b-5588b34211a4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52852024-08-27T19:07:12.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73bfb7b3-9605-40d9-b549-189b9ffb8b1f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52862024-08-27T19:07:12.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73bfb7b3-9605-40d9-b549-189b9ffb8b1f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52872024-08-27T19:07:12.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73bfb7b3-9605-40d9-b549-189b9ffb8b1f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52882024-08-27T19:07:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bae09ab3-9106-44e9-b163-10a981553c15 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52892024-08-27T19:07:13.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bae09ab3-9106-44e9-b163-10a981553c15 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52902024-08-27T19:07:13.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bae09ab3-9106-44e9-b163-10a981553c15 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52912024-08-27T19:07:14.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0bd2e00e-9092-4aca-8295-c488c33197e6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52922024-08-27T19:07:14.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0bd2e00e-9092-4aca-8295-c488c33197e6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52932024-08-27T19:07:14.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0bd2e00e-9092-4aca-8295-c488c33197e6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52942024-08-27T19:07:15.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = deb8a183-4ae4-4510-966e-7690b7164cb3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52952024-08-27T19:07:15.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = deb8a183-4ae4-4510-966e-7690b7164cb3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52962024-08-27T19:07:15.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = deb8a183-4ae4-4510-966e-7690b7164cb3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52972024-08-27T19:07:16.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 497462aa-f763-4350-b19d-7756b4e6b3a3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52982024-08-27T19:07:16.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 497462aa-f763-4350-b19d-7756b4e6b3a3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
52992024-08-27T19:07:16.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 497462aa-f763-4350-b19d-7756b4e6b3a3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53002024-08-27T19:07:17.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa1181a-d7b1-40a0-a8f6-98d57445b043 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53012024-08-27T19:07:17.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa1181a-d7b1-40a0-a8f6-98d57445b043 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53022024-08-27T19:07:17.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa1181a-d7b1-40a0-a8f6-98d57445b043 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53032024-08-27T19:07:19.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd2114ed-9dac-47f5-82f4-1cb178a02d3e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53042024-08-27T19:07:19.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd2114ed-9dac-47f5-82f4-1cb178a02d3e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53052024-08-27T19:07:19.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd2114ed-9dac-47f5-82f4-1cb178a02d3e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53062024-08-27T19:07:20.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb41da88-21dc-4905-965a-a246e309de74 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53072024-08-27T19:07:20.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb41da88-21dc-4905-965a-a246e309de74 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53082024-08-27T19:07:20.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb41da88-21dc-4905-965a-a246e309de74 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53092024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
53102024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
53112024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53122024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53132024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53142024-08-27T19:07:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53152024-08-27T19:07:20.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162024-08-27T19:07:20.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53172024-08-27T19:07:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53182024-08-27T19:07:20.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.107313ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53192024-08-27T19:07:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53202024-08-27T19:07:20.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53212024-08-27T19:07:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222024-08-27T19:07:20.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53232024-08-27T19:07:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53242024-08-27T19:07:20.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252024-08-27T19:07:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
53262024-08-27T19:07:20.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53272024-08-27T19:07:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282024-08-27T19:07:20.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
53292024-08-27T19:07:20.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.630079ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
53302024-08-27T19:07:20.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 536 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = c17554fb-4eca-4a0c-9c7a-e2d8b3a34975 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
53312024-08-27T19:07:21.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4923e5ae-c768-4de4-a655-7adf9f24e008 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53322024-08-27T19:07:21.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4923e5ae-c768-4de4-a655-7adf9f24e008 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53332024-08-27T19:07:21.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4923e5ae-c768-4de4-a655-7adf9f24e008 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53342024-08-27T19:07:22.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee978a6e-2cbb-4a81-93ad-900212b59a8e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53352024-08-27T19:07:22.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee978a6e-2cbb-4a81-93ad-900212b59a8e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53362024-08-27T19:07:22.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ee978a6e-2cbb-4a81-93ad-900212b59a8e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53372024-08-27T19:07:23.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 09b23dbb-17c2-4eac-99bf-6420a865a030 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53382024-08-27T19:07:23.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 09b23dbb-17c2-4eac-99bf-6420a865a030 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53392024-08-27T19:07:23.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 09b23dbb-17c2-4eac-99bf-6420a865a030 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53402024-08-27T19:07:24.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 48e762c6-bc2a-4210-a377-8b7e6817db17 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53412024-08-27T19:07:24.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 48e762c6-bc2a-4210-a377-8b7e6817db17 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53422024-08-27T19:07:24.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 48e762c6-bc2a-4210-a377-8b7e6817db17 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53432024-08-27T19:07:25.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e0045ab-7073-480d-9c7e-0b09e8044f9e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53442024-08-27T19:07:25.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e0045ab-7073-480d-9c7e-0b09e8044f9e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53452024-08-27T19:07:25.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e0045ab-7073-480d-9c7e-0b09e8044f9e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53462024-08-27T19:07:26.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 84f8ebf9-f7ca-4549-b809-925677562b1e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53472024-08-27T19:07:26.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 84f8ebf9-f7ca-4549-b809-925677562b1e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53482024-08-27T19:07:26.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 84f8ebf9-f7ca-4549-b809-925677562b1e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53492024-08-27T19:07:27.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a363ac08-52fc-4c04-8171-0e1f04c10840 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53502024-08-27T19:07:27.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a363ac08-52fc-4c04-8171-0e1f04c10840 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53512024-08-27T19:07:27.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a363ac08-52fc-4c04-8171-0e1f04c10840 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53522024-08-27T19:07:28.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1da40dd5-0984-42bc-b7f1-32786cc0754c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53532024-08-27T19:07:28.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1da40dd5-0984-42bc-b7f1-32786cc0754c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53542024-08-27T19:07:28.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1da40dd5-0984-42bc-b7f1-32786cc0754c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53552024-08-27T19:07:29.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb7d7f20-1aa3-4c87-afb8-781671b69d71 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53562024-08-27T19:07:29.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb7d7f20-1aa3-4c87-afb8-781671b69d71 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53572024-08-27T19:07:29.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eb7d7f20-1aa3-4c87-afb8-781671b69d71 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
53582024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
53592024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
53602024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53612024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53622024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
53632024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53642024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
53652024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53662024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
53672024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53682024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
53692024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
53702024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53712024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53722024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
53732024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53742024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
53752024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53762024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
53772024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
53782024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53792024-08-27T19:07:30.229ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
53802024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53812024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.75\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
53822024-08-27T19:07:30.229ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
53832024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53842024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
53852024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53862024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
53872024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53882024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53892024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
53902024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
53912024-08-27T19:07:30.230ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53922024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53932024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
53942024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
53952024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
53962024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
53972024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53982024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
53992024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54002024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
54012024-08-27T19:07:30.230ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:57:30.230004335 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
54022024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54032024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
54042024-08-27T19:07:30.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
54052024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54062024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
54072024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54082024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
54092024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
54102024-08-27T19:07:30.230ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
54112024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54122024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54132024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
54142024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54152024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
54162024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54172024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
54182024-08-27T19:07:30.230ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
54192024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54202024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54212024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54222024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54232024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54242024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54252024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54262024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54272024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54282024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54292024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54302024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54312024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54322024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54332024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54342024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54352024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54362024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54372024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54382024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54392024-08-27T19:07:30.230ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 884585640 } })
54402024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54412024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54422024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54432024-08-27T19:07:30.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54442024-08-27T19:07:30.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452024-08-27T19:07:30.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 886086790 } })
54462024-08-27T19:07:30.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54472024-08-27T19:07:30.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54482024-08-27T19:07:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54492024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54502024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.42779ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54512024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54522024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
54542024-08-27T19:07:30.233ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.854859ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
54552024-08-27T19:07:30.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 887791575 } })
54562024-08-27T19:07:30.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-08-27T19:07:30.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54582024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
54592024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.215166ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
54602024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.763398ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54612024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-08-27T19:07:30.235ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54642024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54652024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54662024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54672024-08-27T19:07:30.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54682024-08-27T19:07:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54692024-08-27T19:07:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54702024-08-27T19:07:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54712024-08-27T19:07:30.236ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54722024-08-27T19:07:30.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
54732024-08-27T19:07:30.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 890658724 } })
54742024-08-27T19:07:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54752024-08-27T19:07:30.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
54762024-08-27T19:07:30.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54772024-08-27T19:07:30.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54782024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54802024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54812024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54822024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54832024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54842024-08-27T19:07:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54852024-08-27T19:07:30.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 893066363 } })
54862024-08-27T19:07:30.239ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54872024-08-27T19:07:30.239ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54882024-08-27T19:07:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 9.620316ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54892024-08-27T19:07:30.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
54902024-08-27T19:07:30.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54912024-08-27T19:07:30.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54922024-08-27T19:07:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54932024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54942024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54952024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54962024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54982024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54992024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55002024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55012024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55022024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55032024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55042024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55052024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55062024-08-27T19:07:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.77375ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
55072024-08-27T19:07:30.241ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
55082024-08-27T19:07:30.241ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
55092024-08-27T19:07:30.241ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.486345ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
55102024-08-27T19:07:30.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55112024-08-27T19:07:30.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.863322ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
55122024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55132024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55142024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55152024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55162024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55172024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55182024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55192024-08-27T19:07:30.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55202024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55212024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55222024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55232024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55242024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55252024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55262024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55272024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.508676ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
55282024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55292024-08-27T19:07:30.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55302024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55312024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55332024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55342024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55352024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55362024-08-27T19:07:30.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-08-27T19:07:30.245ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
55382024-08-27T19:07:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 15.192041ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55392024-08-27T19:07:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55402024-08-27T19:07:30.245ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:57:30.230004335 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
55412024-08-27T19:07:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.309692ms iteration = 6 status = {"expiration":"2024-08-27T18:57:30.230004335Z","pruned":[]}
55422024-08-27T19:07:30.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55432024-08-27T19:07:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55442024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55452024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55462024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55472024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55482024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55492024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55502024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512024-08-27T19:07:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55522024-08-27T19:07:30.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55532024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55542024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55552024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55562024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55572024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55582024-08-27T19:07:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55592024-08-27T19:07:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55602024-08-27T19:07:30.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55612024-08-27T19:07:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55622024-08-27T19:07:30.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55632024-08-27T19:07:30.249ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55642024-08-27T19:07:30.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.157051ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55652024-08-27T19:07:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55662024-08-27T19:07:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
55672024-08-27T19:07:30.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55682024-08-27T19:07:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55692024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55702024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55712024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55722024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55732024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55742024-08-27T19:07:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55752024-08-27T19:07:30.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55762024-08-27T19:07:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55772024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55782024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55792024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55802024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55812024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55822024-08-27T19:07:30.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 23.885277ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55832024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55842024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55852024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55862024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55872024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882024-08-27T19:07:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55892024-08-27T19:07:30.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55902024-08-27T19:07:30.256ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55912024-08-27T19:07:30.256ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
55922024-08-27T19:07:30.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55932024-08-27T19:07:30.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d97dc766-5cda-4aae-a500-b6e015c65c20 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
55942024-08-27T19:07:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55952024-08-27T19:07:30.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d97dc766-5cda-4aae-a500-b6e015c65c20 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
55962024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
55972024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.666955ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
55982024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 27.610993ms iteration = 13 status = {"physical_disks_added":0}
55992024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
56002024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56012024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56022024-08-27T19:07:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56032024-08-27T19:07:30.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d97dc766-5cda-4aae-a500-b6e015c65c20 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
56042024-08-27T19:07:30.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56052024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56062024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56072024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56082024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56092024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56102024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56112024-08-27T19:07:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56122024-08-27T19:07:30.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56132024-08-27T19:07:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56142024-08-27T19:07:30.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56152024-08-27T19:07:30.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56162024-08-27T19:07:30.261ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
56172024-08-27T19:07:30.261ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56182024-08-27T19:07:30.261ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
56192024-08-27T19:07:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 31.768209ms iteration = 6 status = {"generation":1}
56202024-08-27T19:07:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56212024-08-27T19:07:30.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56222024-08-27T19:07:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56232024-08-27T19:07:30.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56242024-08-27T19:07:30.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56252024-08-27T19:07:30.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56262024-08-27T19:07:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56272024-08-27T19:07:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56282024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
56292024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56302024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
56312024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 34.393102ms iteration = 6 status = {"generation":2}
56322024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
56332024-08-27T19:07:30.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56342024-08-27T19:07:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56352024-08-27T19:07:30.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56362024-08-27T19:07:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56372024-08-27T19:07:30.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56382024-08-27T19:07:30.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56392024-08-27T19:07:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56402024-08-27T19:07:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
56412024-08-27T19:07:30.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56422024-08-27T19:07:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56432024-08-27T19:07:30.270ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56442024-08-27T19:07:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56452024-08-27T19:07:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 42.307863ms iteration = 11 status = 0
56462024-08-27T19:07:30.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56472024-08-27T19:07:30.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56482024-08-27T19:07:30.273ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56492024-08-27T19:07:30.273ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56502024-08-27T19:07:30.273ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 43.335315ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56512024-08-27T19:07:30.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56522024-08-27T19:07:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56532024-08-27T19:07:30.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56542024-08-27T19:07:30.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56552024-08-27T19:07:30.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56562024-08-27T19:07:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56572024-08-27T19:07:30.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56582024-08-27T19:07:30.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
56592024-08-27T19:07:30.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56602024-08-27T19:07:30.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56612024-08-27T19:07:30.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56622024-08-27T19:07:30.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56632024-08-27T19:07:30.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56642024-08-27T19:07:30.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56652024-08-27T19:07:30.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56662024-08-27T19:07:30.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56672024-08-27T19:07:30.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56682024-08-27T19:07:30.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56692024-08-27T19:07:30.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56702024-08-27T19:07:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56712024-08-27T19:07:30.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56722024-08-27T19:07:30.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56732024-08-27T19:07:30.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56742024-08-27T19:07:30.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
56752024-08-27T19:07:30.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56762024-08-27T19:07:30.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56772024-08-27T19:07:30.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56782024-08-27T19:07:30.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56792024-08-27T19:07:30.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56802024-08-27T19:07:30.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56812024-08-27T19:07:30.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56822024-08-27T19:07:30.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
56832024-08-27T19:07:30.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56842024-08-27T19:07:30.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56852024-08-27T19:07:30.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56862024-08-27T19:07:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56872024-08-27T19:07:30.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56882024-08-27T19:07:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56892024-08-27T19:07:30.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56902024-08-27T19:07:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56912024-08-27T19:07:30.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56922024-08-27T19:07:30.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56932024-08-27T19:07:30.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56942024-08-27T19:07:30.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56952024-08-27T19:07:30.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56962024-08-27T19:07:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56972024-08-27T19:07:30.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56982024-08-27T19:07:30.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56992024-08-27T19:07:30.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57002024-08-27T19:07:30.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
57012024-08-27T19:07:30.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57022024-08-27T19:07:30.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57032024-08-27T19:07:30.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57042024-08-27T19:07:30.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57052024-08-27T19:07:30.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57062024-08-27T19:07:30.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57072024-08-27T19:07:30.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57082024-08-27T19:07:30.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
57092024-08-27T19:07:30.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57102024-08-27T19:07:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57112024-08-27T19:07:30.408ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
57122024-08-27T19:07:30.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57132024-08-27T19:07:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57142024-08-27T19:07:30.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57152024-08-27T19:07:30.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
57162024-08-27T19:07:30.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57172024-08-27T19:07:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57182024-08-27T19:07:30.412ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
57192024-08-27T19:07:30.412ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
57202024-08-27T19:07:30.412ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
57212024-08-27T19:07:30.438ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57222024-08-27T19:07:30.457ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
57232024-08-27T19:07:30.457ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57242024-08-27T19:07:30.458ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "15f1d6a7-e54a-453e-be85-c8f58aae327e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57252024-08-27T19:07:30.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57262024-08-27T19:07:30.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57272024-08-27T19:07:30.473ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
57282024-08-27T19:07:30.473ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57292024-08-27T19:07:30.473ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e4aadd-7e52-499d-a445-ed683f68cbcc", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57302024-08-27T19:07:30.473ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57312024-08-27T19:07:30.475ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
57322024-08-27T19:07:30.540ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e38b401b-2d22-4589-ac73-fc644b0a15b2, time_created: 2024-08-27T19:02:55.159379Z, time_modified: 2024-08-27T19:02:55.159379Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
57332024-08-27T19:07:30.540ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
57342024-08-27T19:07:30.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57352024-08-27T19:07:30.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57362024-08-27T19:07:30.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57372024-08-27T19:07:30.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57382024-08-27T19:07:30.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57392024-08-27T19:07:30.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
57402024-08-27T19:07:30.582ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
57412024-08-27T19:07:30.582ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57422024-08-27T19:07:30.583ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "be09da8c-db22-409f-baae-8d351699054f", "content-length": "26", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57432024-08-27T19:07:30.583ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57442024-08-27T19:07:30.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57452024-08-27T19:07:30.589ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
57462024-08-27T19:07:30.611ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57472024-08-27T19:07:30.611ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0121330f-56ac-4c81-b915-5e2fe7fabc0e", "content-length": "372", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57482024-08-27T19:07:30.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57492024-08-27T19:07:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57502024-08-27T19:07:30.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57512024-08-27T19:07:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57522024-08-27T19:07:30.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57532024-08-27T19:07:30.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57542024-08-27T19:07:30.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57552024-08-27T19:07:30.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57562024-08-27T19:07:30.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57572024-08-27T19:07:30.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57582024-08-27T19:07:30.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57592024-08-27T19:07:30.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57602024-08-27T19:07:30.619ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57612024-08-27T19:07:30.620ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ac896234-ec02-4d3c-a5a0-a619f5c27763", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57622024-08-27T19:07:30.621ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.155603ms iteration = 11 status = {}
57632024-08-27T19:07:30.633ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
57642024-08-27T19:07:30.633ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.27516ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57652024-08-27T19:07:30.659ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57662024-08-27T19:07:30.659ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8dc77af8-b9fe-4330-b17f-20692691a6df", "content-length": "691", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57672024-08-27T19:07:30.659ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57682024-08-27T19:07:30.659ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57692024-08-27T19:07:30.659ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57702024-08-27T19:07:30.661ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 431.65318ms iteration = 11 status = {}
57712024-08-27T19:07:30.686ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57722024-08-27T19:07:30.686ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dcca750-59f1-4abd-b0de-c769dc816cbb", "content-length": "1", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57732024-08-27T19:07:30.688ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57742024-08-27T19:07:30.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57752024-08-27T19:07:30.690ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 460.359006ms iteration = 11 status = null
57762024-08-27T19:07:30.748ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
57772024-08-27T19:07:30.770ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57782024-08-27T19:07:30.771ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4471e7da-2064-417e-acc7-ca9b473d162b", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57792024-08-27T19:07:30.771ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57802024-08-27T19:07:30.773ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d0b11223-34f9-4b5d-bddf-9141718e9f57", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57812024-08-27T19:07:30.774ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57822024-08-27T19:07:30.775ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57832024-08-27T19:07:30.775ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 545.402882ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57842024-08-27T19:07:30.849ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
57852024-08-27T19:07:30.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 632.329406ms iteration = 11 status = {}
57862024-08-27T19:07:30.871ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ca5844c8-9472-42c7-8efb-edf753ff4165", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
57872024-08-27T19:07:30.873ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
57882024-08-27T19:07:30.873ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 643.601376ms
57892024-08-27T19:07:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 643.610146ms iteration = 2 status = {}
57902024-08-27T19:07:30.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 490 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 8267fe42-3b90-4178-aadf-bc1ccdb35394 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
57912024-08-27T19:07:30.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57922024-08-27T19:07:30.946ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6bd492ce-00f7-4443-a7b7-384a7d8afdb1", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57932024-08-27T19:07:30.946ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57942024-08-27T19:07:30.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ccff0cfa-f167-4907-ba38-a0411d7c3424", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57952024-08-27T19:07:30.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57962024-08-27T19:07:30.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "18224159-fcac-458e-930d-9dd7817c2b8d", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57972024-08-27T19:07:30.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57982024-08-27T19:07:30.951ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
57992024-08-27T19:07:30.951ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 722.052027ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
58002024-08-27T19:07:30.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58012024-08-27T19:07:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58022024-08-27T19:07:30.979ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
58032024-08-27T19:07:30.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58042024-08-27T19:07:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58052024-08-27T19:07:30.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58062024-08-27T19:07:30.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8616de9f-0c70-4518-bbae-9c36e87be34d", "content-length": "121", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
58072024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
58082024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
58092024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58102024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58112024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
58122024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
58132024-08-27T19:07:30.988ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
58142024-08-27T19:07:30.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58152024-08-27T19:07:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58162024-08-27T19:07:30.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58172024-08-27T19:07:30.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c7ba508-1333-484f-aeb9-6d19e5c52f18", "content-length": "2", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
58182024-08-27T19:07:30.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58192024-08-27T19:07:30.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fd09ba8a-96ff-4e55-9857-6a82bed8ce1a", "content-length": "52", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
58202024-08-27T19:07:30.990ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
58212024-08-27T19:07:30.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58222024-08-27T19:07:31.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 722fde73-c43b-4ec0-bbbb-a02ad837f1cc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
58232024-08-27T19:07:31.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 722fde73-c43b-4ec0-bbbb-a02ad837f1cc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
58242024-08-27T19:07:31.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 722fde73-c43b-4ec0-bbbb-a02ad837f1cc response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
58252024-08-27T19:07:31.087ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b8b54f12-58e0-4add-b4d7-6e7efabe56bf", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
58262024-08-27T19:07:31.087ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
58272024-08-27T19:07:31.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58282024-08-27T19:07:31.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d6570123-0991-446f-8423-0dda004bb694", "content-length": "667", "date": "Tue, 27 Aug 2024 19:07:30 GMT"} })
58292024-08-27T19:07:31.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58302024-08-27T19:07:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58312024-08-27T19:07:31.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58322024-08-27T19:07:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58332024-08-27T19:07:31.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58342024-08-27T19:07:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58352024-08-27T19:07:31.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58362024-08-27T19:07:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58372024-08-27T19:07:31.101ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 871.339524ms iteration = 11 status = {}
58382024-08-27T19:07:31.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7417a8fb-2455-499d-9ee5-52a2147f3e12 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58392024-08-27T19:07:31.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7417a8fb-2455-499d-9ee5-52a2147f3e12 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58402024-08-27T19:07:31.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7417a8fb-2455-499d-9ee5-52a2147f3e12 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58412024-08-27T19:07:32.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4540351e-a294-4ad9-8f9f-4ffa60c15fe0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58422024-08-27T19:07:32.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4540351e-a294-4ad9-8f9f-4ffa60c15fe0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58432024-08-27T19:07:32.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4540351e-a294-4ad9-8f9f-4ffa60c15fe0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58442024-08-27T19:07:33.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 619cb6cc-a795-41c0-8211-602094bc67a1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58452024-08-27T19:07:33.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 619cb6cc-a795-41c0-8211-602094bc67a1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58462024-08-27T19:07:33.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 619cb6cc-a795-41c0-8211-602094bc67a1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58472024-08-27T19:07:34.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 23fe5377-3e84-4c9d-9eba-3f6b2480a7d6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58482024-08-27T19:07:34.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 23fe5377-3e84-4c9d-9eba-3f6b2480a7d6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58492024-08-27T19:07:34.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 23fe5377-3e84-4c9d-9eba-3f6b2480a7d6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58502024-08-27T19:07:35.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b8e2db9-f65f-48a9-be7b-d39d910ba9e9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58512024-08-27T19:07:35.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b8e2db9-f65f-48a9-be7b-d39d910ba9e9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58522024-08-27T19:07:35.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b8e2db9-f65f-48a9-be7b-d39d910ba9e9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58532024-08-27T19:07:36.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53bc740c-086c-4fa6-83b4-b57684cce50c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58542024-08-27T19:07:36.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53bc740c-086c-4fa6-83b4-b57684cce50c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58552024-08-27T19:07:36.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 53bc740c-086c-4fa6-83b4-b57684cce50c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58562024-08-27T19:07:37.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c53416b4-bd8b-4663-82b6-0a234e93f847 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58572024-08-27T19:07:37.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c53416b4-bd8b-4663-82b6-0a234e93f847 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58582024-08-27T19:07:37.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c53416b4-bd8b-4663-82b6-0a234e93f847 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58592024-08-27T19:07:38.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 002a0186-05f8-4114-83a6-f9f09401d75d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58602024-08-27T19:07:38.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 002a0186-05f8-4114-83a6-f9f09401d75d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58612024-08-27T19:07:38.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 002a0186-05f8-4114-83a6-f9f09401d75d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58622024-08-27T19:07:39.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3cf4d30-9822-430d-96bb-37c3fecc92f0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58632024-08-27T19:07:39.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3cf4d30-9822-430d-96bb-37c3fecc92f0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58642024-08-27T19:07:39.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3cf4d30-9822-430d-96bb-37c3fecc92f0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58652024-08-27T19:07:40.228ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
58662024-08-27T19:07:40.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58672024-08-27T19:07:40.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
58682024-08-27T19:07:40.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58692024-08-27T19:07:40.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58702024-08-27T19:07:40.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58712024-08-27T19:07:40.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58722024-08-27T19:07:40.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58732024-08-27T19:07:40.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58742024-08-27T19:07:40.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.342059ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58752024-08-27T19:07:40.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58762024-08-27T19:07:40.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58772024-08-27T19:07:40.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58782024-08-27T19:07:40.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58792024-08-27T19:07:40.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58802024-08-27T19:07:40.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58812024-08-27T19:07:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
58822024-08-27T19:07:40.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58832024-08-27T19:07:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58842024-08-27T19:07:40.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
58852024-08-27T19:07:40.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.332573ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
58862024-08-27T19:07:40.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f81db7e-ab38-48f8-9237-fd5fa119639e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58872024-08-27T19:07:40.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f81db7e-ab38-48f8-9237-fd5fa119639e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58882024-08-27T19:07:40.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f81db7e-ab38-48f8-9237-fd5fa119639e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58892024-08-27T19:07:40.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 471 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 30cb6222-34e0-403f-a658-8843532952fe response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
58902024-08-27T19:07:41.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7deb4846-8f68-4798-9455-e3f07d146cda roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58912024-08-27T19:07:41.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7deb4846-8f68-4798-9455-e3f07d146cda resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58922024-08-27T19:07:41.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7deb4846-8f68-4798-9455-e3f07d146cda response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58932024-08-27T19:07:42.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbeb0b5c-f4b1-4e17-a2a1-616fa89c3de7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58942024-08-27T19:07:42.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbeb0b5c-f4b1-4e17-a2a1-616fa89c3de7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58952024-08-27T19:07:42.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dbeb0b5c-f4b1-4e17-a2a1-616fa89c3de7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58962024-08-27T19:07:43.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3d37c50-feb2-4ece-8848-d77749fd1ef1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58972024-08-27T19:07:43.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3d37c50-feb2-4ece-8848-d77749fd1ef1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58982024-08-27T19:07:43.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3d37c50-feb2-4ece-8848-d77749fd1ef1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
58992024-08-27T19:07:44.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 987065f6-c2a8-4637-b464-8727a95781cd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59002024-08-27T19:07:44.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 987065f6-c2a8-4637-b464-8727a95781cd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59012024-08-27T19:07:44.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 987065f6-c2a8-4637-b464-8727a95781cd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59022024-08-27T19:07:45.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01cd1a63-bc4a-478f-8c3e-298cdf85bf26 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59032024-08-27T19:07:45.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01cd1a63-bc4a-478f-8c3e-298cdf85bf26 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59042024-08-27T19:07:45.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01cd1a63-bc4a-478f-8c3e-298cdf85bf26 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59052024-08-27T19:07:46.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa8d29be-c24a-4c50-8f57-a80340e5b05d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59062024-08-27T19:07:46.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa8d29be-c24a-4c50-8f57-a80340e5b05d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59072024-08-27T19:07:46.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = aa8d29be-c24a-4c50-8f57-a80340e5b05d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59082024-08-27T19:07:47.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34f13e2a-ca43-4b17-b481-2659d5e7f630 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59092024-08-27T19:07:47.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34f13e2a-ca43-4b17-b481-2659d5e7f630 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59102024-08-27T19:07:47.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 34f13e2a-ca43-4b17-b481-2659d5e7f630 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59112024-08-27T19:07:48.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ae70f27f-9737-479f-bb2a-70915b2197e2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59122024-08-27T19:07:48.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ae70f27f-9737-479f-bb2a-70915b2197e2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59132024-08-27T19:07:48.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ae70f27f-9737-479f-bb2a-70915b2197e2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59142024-08-27T19:07:49.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0717eb9f-0b0a-47e1-b5c1-3fbb3e891319 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59152024-08-27T19:07:49.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0717eb9f-0b0a-47e1-b5c1-3fbb3e891319 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59162024-08-27T19:07:49.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0717eb9f-0b0a-47e1-b5c1-3fbb3e891319 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59172024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
59182024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
59192024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59202024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59212024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59222024-08-27T19:07:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59232024-08-27T19:07:50.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59242024-08-27T19:07:50.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252024-08-27T19:07:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59262024-08-27T19:07:50.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.690565ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59272024-08-27T19:07:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59282024-08-27T19:07:50.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59292024-08-27T19:07:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59302024-08-27T19:07:50.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59312024-08-27T19:07:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59322024-08-27T19:07:50.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59332024-08-27T19:07:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
59342024-08-27T19:07:50.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59352024-08-27T19:07:50.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59362024-08-27T19:07:50.243ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
59372024-08-27T19:07:50.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.527107ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
59382024-08-27T19:07:50.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c15e49-3b8d-498c-a577-dfa8a6f32bd9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59392024-08-27T19:07:50.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c15e49-3b8d-498c-a577-dfa8a6f32bd9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59402024-08-27T19:07:50.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c15e49-3b8d-498c-a577-dfa8a6f32bd9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59412024-08-27T19:07:50.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1147 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 111ae24e-e697-4f60-a39d-2aebb54ba329 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
59422024-08-27T19:07:51.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d88bd2ff-368a-48b7-844e-f1e9ac3b59e4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59432024-08-27T19:07:51.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d88bd2ff-368a-48b7-844e-f1e9ac3b59e4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59442024-08-27T19:07:51.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d88bd2ff-368a-48b7-844e-f1e9ac3b59e4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59452024-08-27T19:07:52.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f835d7e-c64b-4c86-a97e-b12ca15faba4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59462024-08-27T19:07:52.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f835d7e-c64b-4c86-a97e-b12ca15faba4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59472024-08-27T19:07:52.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f835d7e-c64b-4c86-a97e-b12ca15faba4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59482024-08-27T19:07:53.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9c14b0a8-206e-4bb8-9479-bed04d06d2e9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59492024-08-27T19:07:53.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9c14b0a8-206e-4bb8-9479-bed04d06d2e9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59502024-08-27T19:07:53.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9c14b0a8-206e-4bb8-9479-bed04d06d2e9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59512024-08-27T19:07:54.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a6bf091-2ac8-4bb0-81f0-1850d178011d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59522024-08-27T19:07:54.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a6bf091-2ac8-4bb0-81f0-1850d178011d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59532024-08-27T19:07:54.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8a6bf091-2ac8-4bb0-81f0-1850d178011d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59542024-08-27T19:07:55.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d02bcc4-c6e8-435c-a76c-0181b015d65b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59552024-08-27T19:07:55.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d02bcc4-c6e8-435c-a76c-0181b015d65b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59562024-08-27T19:07:55.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7d02bcc4-c6e8-435c-a76c-0181b015d65b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59572024-08-27T19:07:56.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f95a861-6fbc-481a-851a-fc21738cc462 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59582024-08-27T19:07:56.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f95a861-6fbc-481a-851a-fc21738cc462 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59592024-08-27T19:07:56.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f95a861-6fbc-481a-851a-fc21738cc462 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59602024-08-27T19:07:57.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bfadb1-80e3-4c92-99f3-67adecaaf9fe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59612024-08-27T19:07:57.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bfadb1-80e3-4c92-99f3-67adecaaf9fe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59622024-08-27T19:07:57.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bfadb1-80e3-4c92-99f3-67adecaaf9fe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59632024-08-27T19:07:58.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0ef376a-7b92-4754-988d-5eeb87a97c9a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59642024-08-27T19:07:58.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0ef376a-7b92-4754-988d-5eeb87a97c9a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59652024-08-27T19:07:58.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f0ef376a-7b92-4754-988d-5eeb87a97c9a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59662024-08-27T19:07:59.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 71d06c97-d841-4bbf-ab4e-380401b7391a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59672024-08-27T19:07:59.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 71d06c97-d841-4bbf-ab4e-380401b7391a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59682024-08-27T19:07:59.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 71d06c97-d841-4bbf-ab4e-380401b7391a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
59692024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
59702024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59712024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
59722024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
59732024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
59742024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59752024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59762024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
59772024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
59782024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59792024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59802024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59812024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
59822024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59832024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
59842024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
59852024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59862024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59872024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
59882024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59892024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
59902024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59912024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
59922024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59932024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59942024-08-27T19:08:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59952024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59962024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59972024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59982024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59992024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60002024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60012024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60022024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60032024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60042024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
60052024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60062024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
60072024-08-27T19:08:00.225ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
60082024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60092024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
60102024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60112024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
60122024-08-27T19:08:00.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60132024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60142024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60152024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60162024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60172024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60182024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60192024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60202024-08-27T19:08:00.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60212024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.753417ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60222024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60232024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60242024-08-27T19:08:00.227ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
60252024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60262024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60272024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60282024-08-27T19:08:00.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292024-08-27T19:08:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60302024-08-27T19:08:00.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60312024-08-27T19:08:00.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.039792ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60322024-08-27T19:08:00.228ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 887843938 } })
60332024-08-27T19:08:00.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.992161ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
60342024-08-27T19:08:00.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60352024-08-27T19:08:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60362024-08-27T19:08:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60372024-08-27T19:08:00.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60382024-08-27T19:08:00.229ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
60392024-08-27T19:08:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60402024-08-27T19:08:00.230ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
60412024-08-27T19:08:00.230ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60422024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.549123ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
60432024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60442024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60452024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60462024-08-27T19:08:00.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
60472024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.806328ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60482024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60492024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60502024-08-27T19:08:00.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60512024-08-27T19:08:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60522024-08-27T19:08:00.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60532024-08-27T19:08:00.231ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 890752948 } })
60542024-08-27T19:08:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60552024-08-27T19:08:00.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.947542ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60562024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.81434ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
60572024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60582024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60592024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60602024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60612024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60622024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60632024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60642024-08-27T19:08:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60652024-08-27T19:08:00.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
60662024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60672024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60682024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60692024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60702024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60712024-08-27T19:08:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60722024-08-27T19:08:00.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60732024-08-27T19:08:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60742024-08-27T19:08:00.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60752024-08-27T19:08:00.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762024-08-27T19:08:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60772024-08-27T19:08:00.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 894919573 } })
60782024-08-27T19:08:00.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
60792024-08-27T19:08:00.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60802024-08-27T19:08:00.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60812024-08-27T19:08:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60822024-08-27T19:08:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
60832024-08-27T19:08:00.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60842024-08-27T19:08:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60852024-08-27T19:08:00.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862024-08-27T19:08:00.240ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60872024-08-27T19:08:00.240ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.388134ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60882024-08-27T19:08:00.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60892024-08-27T19:08:00.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60902024-08-27T19:08:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60912024-08-27T19:08:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 18.845604ms iteration = 14 status = {"physical_disks_added":0}
60922024-08-27T19:08:00.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60932024-08-27T19:08:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60942024-08-27T19:08:00.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
60952024-08-27T19:08:00.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.991118ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
60962024-08-27T19:08:00.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60972024-08-27T19:08:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60982024-08-27T19:08:00.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60992024-08-27T19:08:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61002024-08-27T19:08:00.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61012024-08-27T19:08:00.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61022024-08-27T19:08:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61032024-08-27T19:08:00.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61042024-08-27T19:08:00.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61052024-08-27T19:08:00.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61062024-08-27T19:08:00.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61072024-08-27T19:08:00.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082024-08-27T19:08:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
61092024-08-27T19:08:00.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61102024-08-27T19:08:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61112024-08-27T19:08:00.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61122024-08-27T19:08:00.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61132024-08-27T19:08:00.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61142024-08-27T19:08:00.257ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 32.474573ms iteration = 12 status = 0
61152024-08-27T19:08:00.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
61162024-08-27T19:08:00.333ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61172024-08-27T19:08:00.334ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b0b8bef-91e3-43d9-8ba3-9963a845909e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61182024-08-27T19:08:00.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61192024-08-27T19:08:00.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61202024-08-27T19:08:00.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
61212024-08-27T19:08:00.345ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61222024-08-27T19:08:00.346ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bbcc25-d0f6-44a9-b973-7e8a9b52d5bb", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61232024-08-27T19:08:00.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61242024-08-27T19:08:00.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61252024-08-27T19:08:00.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
61262024-08-27T19:08:00.371ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61272024-08-27T19:08:00.371ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0c23d36-2aa0-40eb-b708-82b36881784d", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61282024-08-27T19:08:00.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61292024-08-27T19:08:00.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
61302024-08-27T19:08:00.376ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61312024-08-27T19:08:00.377ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff633b04-e734-475a-bc77-beee864b3a61", "content-length": "372", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61322024-08-27T19:08:00.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61332024-08-27T19:08:00.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61342024-08-27T19:08:00.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61352024-08-27T19:08:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61362024-08-27T19:08:00.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61372024-08-27T19:08:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61382024-08-27T19:08:00.384ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61392024-08-27T19:08:00.384ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1759199e-afa2-4aa3-a54f-f76db39acd66", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61402024-08-27T19:08:00.385ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.692039ms iteration = 12 status = {}
61412024-08-27T19:08:00.391ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61422024-08-27T19:08:00.391ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3618a694-08ed-46a5-b4a2-b46067c6fb61", "content-length": "691", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61432024-08-27T19:08:00.391ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
61442024-08-27T19:08:00.391ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
61452024-08-27T19:08:00.391ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
61462024-08-27T19:08:00.392ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 168.402807ms iteration = 12 status = {}
61472024-08-27T19:08:00.429ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.865641ms iteration = 12 status = {}
61482024-08-27T19:08:00.437ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61492024-08-27T19:08:00.437ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81f38eb7-ebd3-4943-896d-6c382656035f", "content-length": "1", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61502024-08-27T19:08:00.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61512024-08-27T19:08:00.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61522024-08-27T19:08:00.441ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.916667ms iteration = 12 status = null
61532024-08-27T19:08:00.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61542024-08-27T19:08:00.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61552024-08-27T19:08:00.505ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
61562024-08-27T19:08:00.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61572024-08-27T19:08:00.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61582024-08-27T19:08:00.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61592024-08-27T19:08:00.515ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2978beae-f18e-497b-96c2-94022b9c7498", "content-length": "121", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61602024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
61612024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
61622024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61632024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61642024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
61652024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
61662024-08-27T19:08:00.515ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
61672024-08-27T19:08:00.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61682024-08-27T19:08:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61692024-08-27T19:08:00.526ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61702024-08-27T19:08:00.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67ecc6f1-e061-424e-825c-20d26566a2e1", "content-length": "2", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61712024-08-27T19:08:00.527ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61722024-08-27T19:08:00.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a324a6b1-dea7-49ee-bc4e-100fc7938938", "content-length": "52", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61732024-08-27T19:08:00.527ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
61742024-08-27T19:08:00.527ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61752024-08-27T19:08:00.625ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "94831994-2afb-4fcd-afdd-2341ac4756ca", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61762024-08-27T19:08:00.625ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
61772024-08-27T19:08:00.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61782024-08-27T19:08:00.710ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b239e990-578b-4194-b4f3-b1a26b8874bd", "content-length": "667", "date": "Tue, 27 Aug 2024 19:08:00 GMT"} })
61792024-08-27T19:08:00.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61802024-08-27T19:08:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61812024-08-27T19:08:00.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61822024-08-27T19:08:00.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61832024-08-27T19:08:00.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61842024-08-27T19:08:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61852024-08-27T19:08:00.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61862024-08-27T19:08:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61872024-08-27T19:08:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.457644ms iteration = 12 status = {}
61882024-08-27T19:08:00.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 9c20567c-1d1d-4994-ba4a-4017d418e239 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
61892024-08-27T19:08:00.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bbd1671f-f7d6-4559-b0d9-e69d678b3315 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61902024-08-27T19:08:00.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bbd1671f-f7d6-4559-b0d9-e69d678b3315 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61912024-08-27T19:08:00.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bbd1671f-f7d6-4559-b0d9-e69d678b3315 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61922024-08-27T19:08:01.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 89258a8a-0e0f-4fc2-a12a-c8c589090cbc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
61932024-08-27T19:08:01.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 89258a8a-0e0f-4fc2-a12a-c8c589090cbc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
61942024-08-27T19:08:01.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 89258a8a-0e0f-4fc2-a12a-c8c589090cbc response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
61952024-08-27T19:08:01.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e74d985-a804-422a-926e-0a49dca0a7af roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61962024-08-27T19:08:01.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e74d985-a804-422a-926e-0a49dca0a7af resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61972024-08-27T19:08:01.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e74d985-a804-422a-926e-0a49dca0a7af response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61982024-08-27T19:08:02.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a563a69e-93e6-4ca9-a481-a3e671f7b974 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
61992024-08-27T19:08:02.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a563a69e-93e6-4ca9-a481-a3e671f7b974 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62002024-08-27T19:08:02.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a563a69e-93e6-4ca9-a481-a3e671f7b974 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62012024-08-27T19:08:03.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17f38ad-5756-4f80-b15f-4629c4f73b38 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62022024-08-27T19:08:03.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17f38ad-5756-4f80-b15f-4629c4f73b38 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62032024-08-27T19:08:03.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b17f38ad-5756-4f80-b15f-4629c4f73b38 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62042024-08-27T19:08:04.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c65851f0-459b-4718-86b6-0df0d8fcb9bf roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62052024-08-27T19:08:04.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c65851f0-459b-4718-86b6-0df0d8fcb9bf resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62062024-08-27T19:08:04.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c65851f0-459b-4718-86b6-0df0d8fcb9bf response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62072024-08-27T19:08:06.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b62c2c98-3b50-46e1-8ed0-55444802afdc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62082024-08-27T19:08:06.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b62c2c98-3b50-46e1-8ed0-55444802afdc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62092024-08-27T19:08:06.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b62c2c98-3b50-46e1-8ed0-55444802afdc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62102024-08-27T19:08:07.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 19f47326-8956-486f-8761-932b182738ce roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62112024-08-27T19:08:07.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 19f47326-8956-486f-8761-932b182738ce resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62122024-08-27T19:08:07.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 19f47326-8956-486f-8761-932b182738ce response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62132024-08-27T19:08:08.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f49fa69-0998-4bfb-b631-157324628890 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62142024-08-27T19:08:08.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f49fa69-0998-4bfb-b631-157324628890 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62152024-08-27T19:08:08.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f49fa69-0998-4bfb-b631-157324628890 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62162024-08-27T19:08:09.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 05594371-7672-4c85-89bf-036aeb4a5b6b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62172024-08-27T19:08:09.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 05594371-7672-4c85-89bf-036aeb4a5b6b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62182024-08-27T19:08:09.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 05594371-7672-4c85-89bf-036aeb4a5b6b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62192024-08-27T19:08:10.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b05723b6-b509-439d-a25d-1fae873d6b88 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62202024-08-27T19:08:10.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b05723b6-b509-439d-a25d-1fae873d6b88 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62212024-08-27T19:08:10.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b05723b6-b509-439d-a25d-1fae873d6b88 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62222024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
62232024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
62242024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62252024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62262024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62272024-08-27T19:08:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62282024-08-27T19:08:10.225ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62292024-08-27T19:08:10.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62302024-08-27T19:08:10.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62312024-08-27T19:08:10.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.121344ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62322024-08-27T19:08:10.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62332024-08-27T19:08:10.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62342024-08-27T19:08:10.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62352024-08-27T19:08:10.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62362024-08-27T19:08:10.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62372024-08-27T19:08:10.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62382024-08-27T19:08:10.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
62392024-08-27T19:08:10.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62402024-08-27T19:08:10.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62412024-08-27T19:08:10.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
62422024-08-27T19:08:10.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.905645ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
62432024-08-27T19:08:10.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 532 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 0f1b9ace-b907-44e4-83ab-52c503fba442 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
62442024-08-27T19:08:11.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3796867f-7cf0-491f-a146-708331690fda roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62452024-08-27T19:08:11.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3796867f-7cf0-491f-a146-708331690fda resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62462024-08-27T19:08:11.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3796867f-7cf0-491f-a146-708331690fda response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62472024-08-27T19:08:12.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a6139d3f-18a7-406c-bb4e-c9c90e8d51c9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62482024-08-27T19:08:12.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a6139d3f-18a7-406c-bb4e-c9c90e8d51c9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62492024-08-27T19:08:12.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a6139d3f-18a7-406c-bb4e-c9c90e8d51c9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62502024-08-27T19:08:13.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab24f827-810e-4fca-9eb0-8180aa1edf9d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62512024-08-27T19:08:13.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab24f827-810e-4fca-9eb0-8180aa1edf9d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62522024-08-27T19:08:13.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ab24f827-810e-4fca-9eb0-8180aa1edf9d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62532024-08-27T19:08:14.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80f87b37-038c-4597-9c9d-1d387f07df98 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62542024-08-27T19:08:14.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80f87b37-038c-4597-9c9d-1d387f07df98 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62552024-08-27T19:08:14.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80f87b37-038c-4597-9c9d-1d387f07df98 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62562024-08-27T19:08:15.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f565b89a-e662-4db1-9a46-6d754a106672 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62572024-08-27T19:08:15.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f565b89a-e662-4db1-9a46-6d754a106672 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62582024-08-27T19:08:15.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f565b89a-e662-4db1-9a46-6d754a106672 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62592024-08-27T19:08:16.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69930239-9566-4837-b20a-a6cd10a5305f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62602024-08-27T19:08:16.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69930239-9566-4837-b20a-a6cd10a5305f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62612024-08-27T19:08:16.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69930239-9566-4837-b20a-a6cd10a5305f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62622024-08-27T19:08:17.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 469c37b0-d555-4ba7-9e91-efe24626b6ed roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62632024-08-27T19:08:17.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 469c37b0-d555-4ba7-9e91-efe24626b6ed resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62642024-08-27T19:08:17.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 469c37b0-d555-4ba7-9e91-efe24626b6ed response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62652024-08-27T19:08:18.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4240c531-66da-4940-9f63-d8f76fab3e9b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62662024-08-27T19:08:18.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4240c531-66da-4940-9f63-d8f76fab3e9b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62672024-08-27T19:08:18.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4240c531-66da-4940-9f63-d8f76fab3e9b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62682024-08-27T19:08:19.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c7614e92-fdf5-4c1a-a2f4-2d200cb65bef roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62692024-08-27T19:08:19.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c7614e92-fdf5-4c1a-a2f4-2d200cb65bef resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62702024-08-27T19:08:19.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c7614e92-fdf5-4c1a-a2f4-2d200cb65bef response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62712024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
62722024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62732024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
62742024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62762024-08-27T19:08:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62772024-08-27T19:08:20.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62782024-08-27T19:08:20.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-08-27T19:08:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62802024-08-27T19:08:20.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.065972ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62812024-08-27T19:08:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62822024-08-27T19:08:20.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62832024-08-27T19:08:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62842024-08-27T19:08:20.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62852024-08-27T19:08:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62862024-08-27T19:08:20.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-08-27T19:08:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
62882024-08-27T19:08:20.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62892024-08-27T19:08:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62902024-08-27T19:08:20.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
62912024-08-27T19:08:20.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.385134ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
62922024-08-27T19:08:20.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd832c00-a863-4e0a-9190-d1fadf6826af roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62932024-08-27T19:08:20.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd832c00-a863-4e0a-9190-d1fadf6826af resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62942024-08-27T19:08:20.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fd832c00-a863-4e0a-9190-d1fadf6826af response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62952024-08-27T19:08:20.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 537 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = c5ddcde0-962e-4df9-b246-1808108dae4b response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
62962024-08-27T19:08:21.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e1d2d50-0194-4eb0-bbfc-4e75640f7d75 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62972024-08-27T19:08:21.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e1d2d50-0194-4eb0-bbfc-4e75640f7d75 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62982024-08-27T19:08:21.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e1d2d50-0194-4eb0-bbfc-4e75640f7d75 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
62992024-08-27T19:08:22.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97c5ad6f-3ff4-4e5c-a7e8-b8ed9001ee7e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63002024-08-27T19:08:22.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97c5ad6f-3ff4-4e5c-a7e8-b8ed9001ee7e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63012024-08-27T19:08:22.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 97c5ad6f-3ff4-4e5c-a7e8-b8ed9001ee7e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63022024-08-27T19:08:23.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6af61e97-e7fc-4a21-8b1c-e1191a1f0535 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63032024-08-27T19:08:23.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6af61e97-e7fc-4a21-8b1c-e1191a1f0535 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63042024-08-27T19:08:23.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6af61e97-e7fc-4a21-8b1c-e1191a1f0535 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63052024-08-27T19:08:24.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a5edbbf2-6adf-408f-8a50-b53a77daed86 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63062024-08-27T19:08:24.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a5edbbf2-6adf-408f-8a50-b53a77daed86 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63072024-08-27T19:08:24.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a5edbbf2-6adf-408f-8a50-b53a77daed86 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63082024-08-27T19:08:25.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 206d4de7-4a43-4bae-b6c5-1b25b83c0c43 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63092024-08-27T19:08:25.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 206d4de7-4a43-4bae-b6c5-1b25b83c0c43 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63102024-08-27T19:08:25.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 206d4de7-4a43-4bae-b6c5-1b25b83c0c43 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63112024-08-27T19:08:26.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64cc6881-ad38-4d1f-91cd-5f7652557214 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63122024-08-27T19:08:26.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64cc6881-ad38-4d1f-91cd-5f7652557214 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63132024-08-27T19:08:26.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64cc6881-ad38-4d1f-91cd-5f7652557214 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63142024-08-27T19:08:27.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bcb4423-1dd6-4ecf-bb79-77bc23393f3c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63152024-08-27T19:08:27.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bcb4423-1dd6-4ecf-bb79-77bc23393f3c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63162024-08-27T19:08:27.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bcb4423-1dd6-4ecf-bb79-77bc23393f3c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63172024-08-27T19:08:28.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaac752c-a97f-4016-a882-830f804b31cd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63182024-08-27T19:08:28.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaac752c-a97f-4016-a882-830f804b31cd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63192024-08-27T19:08:28.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = eaac752c-a97f-4016-a882-830f804b31cd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63202024-08-27T19:08:29.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db072b25-ebe0-4278-ba82-adb8556477b4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63212024-08-27T19:08:29.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db072b25-ebe0-4278-ba82-adb8556477b4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63222024-08-27T19:08:29.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = db072b25-ebe0-4278-ba82-adb8556477b4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
63232024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
63242024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
63252024-08-27T19:08:30.223ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:58:30.223454157 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
63262024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
63272024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63282024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
63292024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
63302024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
63312024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
63322024-08-27T19:08:30.223ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
63332024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
63342024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63352024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63362024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63372024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
63382024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
63392024-08-27T19:08:30.223ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
63402024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63412024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
63422024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.471\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
63432024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63442024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
63452024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63462024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
63472024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
63482024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63492024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63502024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63512024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
63522024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63532024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
63542024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
63552024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63562024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
63572024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63582024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
63592024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
63602024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
63612024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63622024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
63632024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63642024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
63652024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
63662024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63672024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
63682024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
63692024-08-27T19:08:30.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63702024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
63712024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63722024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63732024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63742024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63752024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63762024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63772024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63782024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63792024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63802024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63812024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63822024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63832024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63842024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63852024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63862024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63872024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63882024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63892024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63902024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63912024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63922024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63932024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63942024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63952024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
63962024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
63972024-08-27T19:08:30.224ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
63982024-08-27T19:08:30.224ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
63992024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64002024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
64012024-08-27T19:08:30.225ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
64022024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64032024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
64042024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64052024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
64062024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64072024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
64082024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64092024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64102024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64112024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64122024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64132024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64142024-08-27T19:08:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64152024-08-27T19:08:30.225ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 885825410 } })
64162024-08-27T19:08:30.225ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 885829940 } })
64172024-08-27T19:08:30.228ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
64182024-08-27T19:08:30.228ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.595274ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
64192024-08-27T19:08:30.230ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
64202024-08-27T19:08:30.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.809189ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
64212024-08-27T19:08:30.237ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:58:30.223454157 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64222024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.093637ms iteration = 7 status = {"expiration":"2024-08-27T18:58:30.223454157Z","pruned":[]}
64232024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64242024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64262024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64272024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64282024-08-27T19:08:30.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292024-08-27T19:08:30.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64302024-08-27T19:08:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 15.508886ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64312024-08-27T19:08:30.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64322024-08-27T19:08:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64332024-08-27T19:08:30.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64342024-08-27T19:08:30.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64352024-08-27T19:08:30.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64362024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64372024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64382024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64392024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64402024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64412024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64422024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64432024-08-27T19:08:30.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64442024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64452024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64462024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64472024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
64482024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64492024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64502024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64512024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64522024-08-27T19:08:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64532024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64542024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64552024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64562024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64572024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64582024-08-27T19:08:30.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64592024-08-27T19:08:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64602024-08-27T19:08:30.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 905090353 } })
64612024-08-27T19:08:30.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
64622024-08-27T19:08:30.246ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.118611ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
64632024-08-27T19:08:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64642024-08-27T19:08:30.246ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64652024-08-27T19:08:30.246ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64662024-08-27T19:08:30.246ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 23.301036ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64672024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64682024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64692024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64702024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64712024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64722024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64732024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64742024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64752024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64762024-08-27T19:08:30.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64772024-08-27T19:08:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64782024-08-27T19:08:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64792024-08-27T19:08:30.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64802024-08-27T19:08:30.248ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
64812024-08-27T19:08:30.248ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
64822024-08-27T19:08:30.248ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 23.955718ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
64832024-08-27T19:08:30.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64842024-08-27T19:08:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64852024-08-27T19:08:30.250ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64862024-08-27T19:08:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64872024-08-27T19:08:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64882024-08-27T19:08:30.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892024-08-27T19:08:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64902024-08-27T19:08:30.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64912024-08-27T19:08:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64922024-08-27T19:08:30.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932024-08-27T19:08:30.255ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 914912914 } })
64942024-08-27T19:08:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64952024-08-27T19:08:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64962024-08-27T19:08:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64972024-08-27T19:08:30.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64982024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64992024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65002024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65012024-08-27T19:08:30.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
65022024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65032024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65042024-08-27T19:08:30.256ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65052024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.002823ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65062024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65072024-08-27T19:08:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65082024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65092024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
65102024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
65112024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65122024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65132024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65142024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65152024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65162024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65172024-08-27T19:08:30.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.961942ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
65182024-08-27T19:08:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65192024-08-27T19:08:30.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65202024-08-27T19:08:30.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65212024-08-27T19:08:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65222024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65232024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65242024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65252024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65262024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65272024-08-27T19:08:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65282024-08-27T19:08:30.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65292024-08-27T19:08:30.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65302024-08-27T19:08:30.260ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 920498068 } })
65312024-08-27T19:08:30.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65322024-08-27T19:08:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.925574ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65332024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65342024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65352024-08-27T19:08:30.262ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
65362024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65372024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65382024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65392024-08-27T19:08:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65402024-08-27T19:08:30.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65412024-08-27T19:08:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65422024-08-27T19:08:30.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65432024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65452024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65462024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65472024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65482024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65492024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65502024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65512024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65522024-08-27T19:08:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65532024-08-27T19:08:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
65542024-08-27T19:08:30.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65552024-08-27T19:08:30.265ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
65562024-08-27T19:08:30.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 40.600409ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65572024-08-27T19:08:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65582024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
65592024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
65602024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65612024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65622024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
65632024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
65642024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
65652024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 42.832564ms iteration = 7 status = {"generation":1}
65662024-08-27T19:08:30.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
65682024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65702024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65712024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65722024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65732024-08-27T19:08:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65742024-08-27T19:08:30.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65752024-08-27T19:08:30.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65762024-08-27T19:08:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65772024-08-27T19:08:30.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65782024-08-27T19:08:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65792024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65802024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65812024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 45.650682ms iteration = 4 status = {"nsuccess":5}
65822024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65832024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65842024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65852024-08-27T19:08:30.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65862024-08-27T19:08:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65872024-08-27T19:08:30.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65882024-08-27T19:08:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65892024-08-27T19:08:30.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.988939ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
65902024-08-27T19:08:30.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65912024-08-27T19:08:30.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65922024-08-27T19:08:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65932024-08-27T19:08:30.272ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
65942024-08-27T19:08:30.272ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65952024-08-27T19:08:30.272ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
65962024-08-27T19:08:30.272ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 48.276845ms iteration = 7 status = {"generation":2}
65972024-08-27T19:08:30.273ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
65982024-08-27T19:08:30.273ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65992024-08-27T19:08:30.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66002024-08-27T19:08:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66012024-08-27T19:08:30.274ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
66022024-08-27T19:08:30.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.919409ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
66032024-08-27T19:08:30.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66042024-08-27T19:08:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66052024-08-27T19:08:30.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66062024-08-27T19:08:30.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66072024-08-27T19:08:30.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66082024-08-27T19:08:30.279ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66092024-08-27T19:08:30.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66102024-08-27T19:08:30.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
66112024-08-27T19:08:30.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66122024-08-27T19:08:30.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66132024-08-27T19:08:30.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.656648ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66142024-08-27T19:08:30.287ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.778972ms iteration = 13 status = 0
66152024-08-27T19:08:30.308ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 84.815721ms iteration = 15 status = {"physical_disks_added":0}
66162024-08-27T19:08:30.312ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
66172024-08-27T19:08:30.312ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66182024-08-27T19:08:30.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.441535ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
66192024-08-27T19:08:30.316ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
66202024-08-27T19:08:30.316ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 92.841015ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
66212024-08-27T19:08:30.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
66222024-08-27T19:08:30.427ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
66232024-08-27T19:08:30.428ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66242024-08-27T19:08:30.428ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85959bfb-0243-415c-9924-63cbdb93c1bd", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66252024-08-27T19:08:30.428ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66262024-08-27T19:08:30.429ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66272024-08-27T19:08:30.443ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66282024-08-27T19:08:30.444ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd80583-77f8-4686-a6ac-4d800446fd28", "content-length": "372", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66292024-08-27T19:08:30.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66302024-08-27T19:08:30.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66312024-08-27T19:08:30.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66322024-08-27T19:08:30.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66332024-08-27T19:08:30.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66342024-08-27T19:08:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66352024-08-27T19:08:30.453ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66362024-08-27T19:08:30.453ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "887fcf97-4693-43ad-9066-c9ef965db61f", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66372024-08-27T19:08:30.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
66382024-08-27T19:08:30.454ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 229.513455ms iteration = 13 status = {}
66392024-08-27T19:08:30.469ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66402024-08-27T19:08:30.469ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44edb9e1-518f-4fe8-a466-d2681fdabf08", "content-length": "691", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66412024-08-27T19:08:30.469ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66422024-08-27T19:08:30.469ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66432024-08-27T19:08:30.469ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66442024-08-27T19:08:30.472ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 248.765037ms iteration = 13 status = {}
66452024-08-27T19:08:30.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
66462024-08-27T19:08:30.497ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66472024-08-27T19:08:30.498ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d02b2cf8-dfd0-4237-b538-753d0f54c01d", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66482024-08-27T19:08:30.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66492024-08-27T19:08:30.500ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
66502024-08-27T19:08:30.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a30126ec-1b68-4488-b2f5-3fb45171597e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
66512024-08-27T19:08:30.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a30126ec-1b68-4488-b2f5-3fb45171597e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
66522024-08-27T19:08:30.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a30126ec-1b68-4488-b2f5-3fb45171597e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
66532024-08-27T19:08:30.537ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66542024-08-27T19:08:30.552ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
66552024-08-27T19:08:30.552ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66562024-08-27T19:08:30.552ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "759c75b7-525d-41f0-9949-a5e83bf6bd07", "content-length": "26", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66572024-08-27T19:08:30.552ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66582024-08-27T19:08:30.554ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66592024-08-27T19:08:30.600ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 376.672938ms iteration = 13 status = {}
66602024-08-27T19:08:30.620ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66612024-08-27T19:08:30.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "16adf492-162a-44ea-83e5-c9eb55d97403", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66622024-08-27T19:08:30.621ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66632024-08-27T19:08:30.623ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "10970b74-4636-421d-b7ac-c7081d509b59", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66642024-08-27T19:08:30.623ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66652024-08-27T19:08:30.625ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66662024-08-27T19:08:30.625ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 401.402523ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
66672024-08-27T19:08:30.650ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
66682024-08-27T19:08:30.651ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f52e8f94-99ac-40b7-a19d-72b5bcf11339", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66692024-08-27T19:08:30.651ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66702024-08-27T19:08:30.652ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f1d0f2c-88d0-41e7-906c-786a5839a1b7", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66712024-08-27T19:08:30.652ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66722024-08-27T19:08:30.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7d201619-a4b7-4789-ade1-92bf74ae967a", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66732024-08-27T19:08:30.654ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66742024-08-27T19:08:30.656ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66752024-08-27T19:08:30.656ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50935505-c3cc-45ea-b6fe-3599900b7f50", "content-length": "1", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66762024-08-27T19:08:30.657ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
66772024-08-27T19:08:30.657ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 433.787203ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
66782024-08-27T19:08:30.658ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66792024-08-27T19:08:30.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66802024-08-27T19:08:30.660ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 437.02531ms iteration = 13 status = null
66812024-08-27T19:08:30.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66822024-08-27T19:08:30.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66832024-08-27T19:08:30.708ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
66842024-08-27T19:08:30.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66852024-08-27T19:08:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66862024-08-27T19:08:30.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66872024-08-27T19:08:30.716ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97ae2e54-e8f3-4547-91d5-67ca86082467", "content-length": "121", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66882024-08-27T19:08:30.716ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
66892024-08-27T19:08:30.716ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
66902024-08-27T19:08:30.717ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66912024-08-27T19:08:30.717ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66922024-08-27T19:08:30.717ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
66932024-08-27T19:08:30.717ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
66942024-08-27T19:08:30.717ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
66952024-08-27T19:08:30.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66962024-08-27T19:08:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66972024-08-27T19:08:30.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66982024-08-27T19:08:30.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6039b3b0-2a30-41fc-8645-1955cf47fb29", "content-length": "2", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
66992024-08-27T19:08:30.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67002024-08-27T19:08:30.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c363e77-ef29-4fa1-8f1e-8563448c6d13", "content-length": "52", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
67012024-08-27T19:08:30.719ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
67022024-08-27T19:08:30.719ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67032024-08-27T19:08:30.807ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0cc6e67f-cedb-464a-b54b-142d99d57879", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
67042024-08-27T19:08:30.807ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
67052024-08-27T19:08:30.807ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67062024-08-27T19:08:30.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "543d3a9a-c2e6-4623-b46c-961732366d3f", "content-length": "667", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
67072024-08-27T19:08:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67082024-08-27T19:08:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67092024-08-27T19:08:30.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67102024-08-27T19:08:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67112024-08-27T19:08:30.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67122024-08-27T19:08:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67132024-08-27T19:08:30.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67142024-08-27T19:08:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67152024-08-27T19:08:30.826ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 603.026728ms iteration = 13 status = {}
67162024-08-27T19:08:30.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 434 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = c749df78-50df-462c-8fe9-3f1c01be14ae response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
67172024-08-27T19:08:30.874ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
67182024-08-27T19:08:30.874ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
67192024-08-27T19:08:30.904ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
67202024-08-27T19:08:30.904ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:64232
67212024-08-27T19:08:30.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 0208c1b1-be6b-43da-b397-79d4a749290b roles = RoleSet { roles: {} } uri = /metrics/producers
67222024-08-27T19:08:30.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 0208c1b1-be6b-43da-b397-79d4a749290b resource = Database result = Ok(()) uri = /metrics/producers
67232024-08-27T19:08:30.939ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 4acc4057-9e37-454f-b1dd-7cbe37073be1
67242024-08-27T19:08:30.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 0208c1b1-be6b-43da-b397-79d4a749290b roles = RoleSet { roles: {} } uri = /metrics/producers
67252024-08-27T19:08:30.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 0208c1b1-be6b-43da-b397-79d4a749290b resource = Database result = Ok(()) uri = /metrics/producers
67262024-08-27T19:08:30.976ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 uri = http://[fd00:1122:3344:101::d]:12223/producers
67272024-08-27T19:08:30.976ZDEBGnexus: client response oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8d294876-5599-4dad-909b-eb9fda78e493", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
67282024-08-27T19:08:30.976ZINFOnexus: assigned collector to new producer collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 file = nexus/src/app/oximeter.rs:125 producer_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
67292024-08-27T19:08:30.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74243 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 0208c1b1-be6b-43da-b397-79d4a749290b response_code = 201 uri = /metrics/producers
67302024-08-27T19:08:30.979ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "0208c1b1-be6b-43da-b397-79d4a749290b", "content-length": "41", "date": "Tue, 27 Aug 2024 19:08:30 GMT"} })
67312024-08-27T19:08:30.980ZDEBGnexus (producer-registration-task): registered with nexus successfully
67322024-08-27T19:08:30.980ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
67332024-08-27T19:08:31.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 906ec18b-7ca7-41c9-ad42-506aca95dcba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
67342024-08-27T19:08:31.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 906ec18b-7ca7-41c9-ad42-506aca95dcba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
67352024-08-27T19:08:31.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 906ec18b-7ca7-41c9-ad42-506aca95dcba response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
67362024-08-27T19:08:31.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a90199f-55dc-425d-88dc-f531f923d9bb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67372024-08-27T19:08:31.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a90199f-55dc-425d-88dc-f531f923d9bb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67382024-08-27T19:08:31.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a90199f-55dc-425d-88dc-f531f923d9bb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67392024-08-27T19:08:32.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f79c6e6-3ea3-4fc8-9534-5bcf694e6ef0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67402024-08-27T19:08:32.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f79c6e6-3ea3-4fc8-9534-5bcf694e6ef0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67412024-08-27T19:08:32.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8f79c6e6-3ea3-4fc8-9534-5bcf694e6ef0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67422024-08-27T19:08:33.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8502cf34-d657-44f1-829e-0543cf2d81d7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67432024-08-27T19:08:33.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8502cf34-d657-44f1-829e-0543cf2d81d7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67442024-08-27T19:08:33.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8502cf34-d657-44f1-829e-0543cf2d81d7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67452024-08-27T19:08:34.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4313e59-dd4a-4f41-9f1b-736c6ad3558f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67462024-08-27T19:08:34.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4313e59-dd4a-4f41-9f1b-736c6ad3558f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67472024-08-27T19:08:34.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d4313e59-dd4a-4f41-9f1b-736c6ad3558f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67482024-08-27T19:08:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27dfd775-e5af-4940-b77a-769a9e9aada5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67492024-08-27T19:08:35.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27dfd775-e5af-4940-b77a-769a9e9aada5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67502024-08-27T19:08:35.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27dfd775-e5af-4940-b77a-769a9e9aada5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67512024-08-27T19:08:36.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b410594d-6b72-413d-b5b5-e7ab670faab6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67522024-08-27T19:08:36.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b410594d-6b72-413d-b5b5-e7ab670faab6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67532024-08-27T19:08:36.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b410594d-6b72-413d-b5b5-e7ab670faab6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67542024-08-27T19:08:37.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22b270c5-0b93-4825-b446-58a8c933dcb3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67552024-08-27T19:08:37.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22b270c5-0b93-4825-b446-58a8c933dcb3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67562024-08-27T19:08:37.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 22b270c5-0b93-4825-b446-58a8c933dcb3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67572024-08-27T19:08:38.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3378c91f-4c34-47ea-a1f9-90e9f1ccea26 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67582024-08-27T19:08:38.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3378c91f-4c34-47ea-a1f9-90e9f1ccea26 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67592024-08-27T19:08:38.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3378c91f-4c34-47ea-a1f9-90e9f1ccea26 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67602024-08-27T19:08:39.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7061d6e-4dbb-40a9-af5d-c5ebf9742498 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67612024-08-27T19:08:39.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7061d6e-4dbb-40a9-af5d-c5ebf9742498 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67622024-08-27T19:08:39.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7061d6e-4dbb-40a9-af5d-c5ebf9742498 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67632024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
67642024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67652024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
67662024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67672024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67682024-08-27T19:08:40.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67692024-08-27T19:08:40.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67702024-08-27T19:08:40.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67712024-08-27T19:08:40.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67722024-08-27T19:08:40.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.075103ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67732024-08-27T19:08:40.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67742024-08-27T19:08:40.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67752024-08-27T19:08:40.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67762024-08-27T19:08:40.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67772024-08-27T19:08:40.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67782024-08-27T19:08:40.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-08-27T19:08:40.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
67802024-08-27T19:08:40.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67812024-08-27T19:08:40.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67822024-08-27T19:08:40.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
67832024-08-27T19:08:40.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.612878ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
67842024-08-27T19:08:40.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73f39daa-78c3-4d63-8a41-0bf500c6c64d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67852024-08-27T19:08:40.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73f39daa-78c3-4d63-8a41-0bf500c6c64d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67862024-08-27T19:08:40.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73f39daa-78c3-4d63-8a41-0bf500c6c64d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67872024-08-27T19:08:40.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 539 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = f6745054-d431-467b-91c3-13a5efbb8a08 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
67882024-08-27T19:08:41.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2cd0b9c8-cc78-4848-b198-dfee1f435363 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67892024-08-27T19:08:41.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2cd0b9c8-cc78-4848-b198-dfee1f435363 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67902024-08-27T19:08:41.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2cd0b9c8-cc78-4848-b198-dfee1f435363 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67912024-08-27T19:08:42.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b661a9d-cc7a-47ac-b8dc-3fc2d578ab29 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67922024-08-27T19:08:42.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b661a9d-cc7a-47ac-b8dc-3fc2d578ab29 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67932024-08-27T19:08:42.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b661a9d-cc7a-47ac-b8dc-3fc2d578ab29 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67942024-08-27T19:08:43.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 348f4c36-2fc9-404c-8058-cc60d601ab5b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67952024-08-27T19:08:43.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 348f4c36-2fc9-404c-8058-cc60d601ab5b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67962024-08-27T19:08:43.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 348f4c36-2fc9-404c-8058-cc60d601ab5b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67972024-08-27T19:08:44.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc7e31b3-7106-42e3-b58b-e916cbcb7a6c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67982024-08-27T19:08:44.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc7e31b3-7106-42e3-b58b-e916cbcb7a6c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
67992024-08-27T19:08:44.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cc7e31b3-7106-42e3-b58b-e916cbcb7a6c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68002024-08-27T19:08:45.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a03db547-45f8-40cc-bd9a-f6de952f13ab roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68012024-08-27T19:08:45.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a03db547-45f8-40cc-bd9a-f6de952f13ab resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68022024-08-27T19:08:45.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a03db547-45f8-40cc-bd9a-f6de952f13ab response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68032024-08-27T19:08:46.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b30fcf9c-14eb-4f96-ba10-306a39c12e44 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68042024-08-27T19:08:46.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b30fcf9c-14eb-4f96-ba10-306a39c12e44 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68052024-08-27T19:08:46.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b30fcf9c-14eb-4f96-ba10-306a39c12e44 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68062024-08-27T19:08:47.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 92c91a47-afd0-499f-bdbd-3a6ea195aa18 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68072024-08-27T19:08:47.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 92c91a47-afd0-499f-bdbd-3a6ea195aa18 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68082024-08-27T19:08:47.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 92c91a47-afd0-499f-bdbd-3a6ea195aa18 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68092024-08-27T19:08:48.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49b650fd-8ab3-4ff4-bd92-a17882e6556c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68102024-08-27T19:08:48.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49b650fd-8ab3-4ff4-bd92-a17882e6556c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68112024-08-27T19:08:48.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49b650fd-8ab3-4ff4-bd92-a17882e6556c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68122024-08-27T19:08:49.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80b701fa-339a-487f-b268-c2e68c57fde4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68132024-08-27T19:08:49.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80b701fa-339a-487f-b268-c2e68c57fde4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68142024-08-27T19:08:49.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 80b701fa-339a-487f-b268-c2e68c57fde4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68152024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
68162024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
68172024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68182024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68192024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68202024-08-27T19:08:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68212024-08-27T19:08:50.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-08-27T19:08:50.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68232024-08-27T19:08:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68242024-08-27T19:08:50.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.381369ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68252024-08-27T19:08:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68262024-08-27T19:08:50.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68272024-08-27T19:08:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68282024-08-27T19:08:50.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68292024-08-27T19:08:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68302024-08-27T19:08:50.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312024-08-27T19:08:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
68322024-08-27T19:08:50.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68332024-08-27T19:08:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68342024-08-27T19:08:50.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
68352024-08-27T19:08:50.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.230171ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
68362024-08-27T19:08:50.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e038fa2-1d08-41a5-b116-ac364cc4f5dd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68372024-08-27T19:08:50.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e038fa2-1d08-41a5-b116-ac364cc4f5dd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68382024-08-27T19:08:50.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1e038fa2-1d08-41a5-b116-ac364cc4f5dd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68392024-08-27T19:08:50.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 429 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = c8dbbb70-4086-4a73-aa53-9a5fbcfec304 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
68402024-08-27T19:08:51.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c49985be-71df-4669-8e3b-6f0c896e9594 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68412024-08-27T19:08:51.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c49985be-71df-4669-8e3b-6f0c896e9594 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68422024-08-27T19:08:51.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c49985be-71df-4669-8e3b-6f0c896e9594 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68432024-08-27T19:08:53.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7770a11-5a36-4d7f-8e36-2d66eaa112f6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68442024-08-27T19:08:53.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7770a11-5a36-4d7f-8e36-2d66eaa112f6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68452024-08-27T19:08:53.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f7770a11-5a36-4d7f-8e36-2d66eaa112f6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68462024-08-27T19:08:54.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed64f997-b492-4263-83b4-d0dbb7ec7420 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68472024-08-27T19:08:54.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed64f997-b492-4263-83b4-d0dbb7ec7420 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68482024-08-27T19:08:54.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed64f997-b492-4263-83b4-d0dbb7ec7420 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68492024-08-27T19:08:55.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 94bc20f1-ad36-4b2c-9cf1-d76a14cac3e9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68502024-08-27T19:08:55.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 94bc20f1-ad36-4b2c-9cf1-d76a14cac3e9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68512024-08-27T19:08:55.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 94bc20f1-ad36-4b2c-9cf1-d76a14cac3e9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68522024-08-27T19:08:56.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66019867-a6ef-4230-af68-abcef3a1d991 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68532024-08-27T19:08:56.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66019867-a6ef-4230-af68-abcef3a1d991 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68542024-08-27T19:08:56.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 66019867-a6ef-4230-af68-abcef3a1d991 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68552024-08-27T19:08:57.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a3979d7-2c6e-45fe-8bcc-8a1a6f7da93a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68562024-08-27T19:08:57.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a3979d7-2c6e-45fe-8bcc-8a1a6f7da93a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68572024-08-27T19:08:57.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5a3979d7-2c6e-45fe-8bcc-8a1a6f7da93a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68582024-08-27T19:08:57.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e495f416-1f14-4871-a1a4-9a2da492e29a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
68592024-08-27T19:08:57.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e495f416-1f14-4871-a1a4-9a2da492e29a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
68602024-08-27T19:08:57.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e495f416-1f14-4871-a1a4-9a2da492e29a response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
68612024-08-27T19:08:57.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 0a9e70f4-ba14-4899-8bce-8db3d2e7ad27 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
68622024-08-27T19:08:57.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 0a9e70f4-ba14-4899-8bce-8db3d2e7ad27 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
68632024-08-27T19:08:57.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 0a9e70f4-ba14-4899-8bce-8db3d2e7ad27 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
68642024-08-27T19:08:58.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c16936c2-9896-4858-bc8c-05f13bbf859e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68652024-08-27T19:08:58.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c16936c2-9896-4858-bc8c-05f13bbf859e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68662024-08-27T19:08:58.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c16936c2-9896-4858-bc8c-05f13bbf859e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68672024-08-27T19:08:59.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b651f7c0-72bc-4f4f-ad11-3b7b314720e5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68682024-08-27T19:08:59.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b651f7c0-72bc-4f4f-ad11-3b7b314720e5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68692024-08-27T19:08:59.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b651f7c0-72bc-4f4f-ad11-3b7b314720e5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68702024-08-27T19:09:00.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b4561629-e6fd-4418-9769-489328f090c7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68712024-08-27T19:09:00.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b4561629-e6fd-4418-9769-489328f090c7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68722024-08-27T19:09:00.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b4561629-e6fd-4418-9769-489328f090c7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
68732024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
68742024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
68752024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68762024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68772024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
68782024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68792024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
68802024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
68812024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68822024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
68832024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68842024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68852024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
68862024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68872024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
68882024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
68892024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
68902024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
68912024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68922024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68932024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68942024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
68952024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68962024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68972024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
68982024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68992024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
69002024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69012024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
69022024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69032024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
69042024-08-27T19:09:00.222ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
69052024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69062024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69072024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69082024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69092024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69102024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69112024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69122024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69132024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69142024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69152024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69162024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69172024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69182024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69192024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69202024-08-27T19:09:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69212024-08-27T19:09:00.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-08-27T19:09:00.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69232024-08-27T19:09:00.225ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.025321ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69242024-08-27T19:09:00.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 887447798 } })
69252024-08-27T19:09:00.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69262024-08-27T19:09:00.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69272024-08-27T19:09:00.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
69282024-08-27T19:09:00.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292024-08-27T19:09:00.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69302024-08-27T19:09:00.227ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69312024-08-27T19:09:00.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69322024-08-27T19:09:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69332024-08-27T19:09:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69342024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69352024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69362024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69372024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.36745ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
69382024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69392024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69402024-08-27T19:09:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69412024-08-27T19:09:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69422024-08-27T19:09:00.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.86282ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69432024-08-27T19:09:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69442024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.33525ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
69452024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69462024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69472024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69482024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69492024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69502024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69512024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69522024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69532024-08-27T19:09:00.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69542024-08-27T19:09:00.231ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 892859368 } })
69552024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69562024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69572024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69582024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69592024-08-27T19:09:00.231ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
69602024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69612024-08-27T19:09:00.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69622024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69642024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69652024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69662024-08-27T19:09:00.232ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 894167195 } })
69672024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69682024-08-27T19:09:00.232ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
69692024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69702024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.200258ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
69712024-08-27T19:09:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69722024-08-27T19:09:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732024-08-27T19:09:00.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
69742024-08-27T19:09:00.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69752024-08-27T19:09:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69762024-08-27T19:09:00.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772024-08-27T19:09:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69782024-08-27T19:09:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69792024-08-27T19:09:00.234ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
69802024-08-27T19:09:00.234ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69812024-08-27T19:09:00.234ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 12.342002ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
69822024-08-27T19:09:00.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69832024-08-27T19:09:00.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69842024-08-27T19:09:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69852024-08-27T19:09:00.235ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
69862024-08-27T19:09:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.397613ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69872024-08-27T19:09:00.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69882024-08-27T19:09:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69892024-08-27T19:09:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69902024-08-27T19:09:00.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69912024-08-27T19:09:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69922024-08-27T19:09:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
69932024-08-27T19:09:00.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69942024-08-27T19:09:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69952024-08-27T19:09:00.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
69962024-08-27T19:09:00.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.768654ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
69972024-08-27T19:09:00.244ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.479759ms iteration = 16 status = {"physical_disks_added":0}
69982024-08-27T19:09:00.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69992024-08-27T19:09:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70002024-08-27T19:09:00.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70012024-08-27T19:09:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70022024-08-27T19:09:00.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70032024-08-27T19:09:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
70042024-08-27T19:09:00.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70052024-08-27T19:09:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70062024-08-27T19:09:00.253ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 31.004933ms iteration = 14 status = 0
70072024-08-27T19:09:00.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70082024-08-27T19:09:00.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70092024-08-27T19:09:00.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70102024-08-27T19:09:00.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70112024-08-27T19:09:00.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70122024-08-27T19:09:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70132024-08-27T19:09:00.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142024-08-27T19:09:00.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70152024-08-27T19:09:00.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70162024-08-27T19:09:00.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70172024-08-27T19:09:00.385ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
70182024-08-27T19:09:00.406ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
70192024-08-27T19:09:00.406ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70202024-08-27T19:09:00.407ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5a6a3d-2615-46d0-b0f9-5465825b6526", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70212024-08-27T19:09:00.407ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70222024-08-27T19:09:00.409ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
70232024-08-27T19:09:00.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70242024-08-27T19:09:00.462ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70252024-08-27T19:09:00.462ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c6e73564-a8cf-47b7-bfa6-898a2f23e454", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70262024-08-27T19:09:00.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70272024-08-27T19:09:00.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70282024-08-27T19:09:00.492ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70292024-08-27T19:09:00.492ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70302024-08-27T19:09:00.492ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d92eecff-ac79-40af-9474-b0059501351e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70312024-08-27T19:09:00.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70322024-08-27T19:09:00.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70332024-08-27T19:09:00.507ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70342024-08-27T19:09:00.508ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b55eda2-9e6c-4aa5-85c8-59720d7dce9e", "content-length": "583", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70352024-08-27T19:09:00.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70362024-08-27T19:09:00.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70372024-08-27T19:09:00.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70382024-08-27T19:09:00.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70392024-08-27T19:09:00.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70402024-08-27T19:09:00.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70412024-08-27T19:09:00.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70422024-08-27T19:09:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70432024-08-27T19:09:00.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70442024-08-27T19:09:00.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70452024-08-27T19:09:00.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70462024-08-27T19:09:00.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70472024-08-27T19:09:00.521ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70482024-08-27T19:09:00.522ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4a20f577-c115-4924-a0a6-f466a9f3c620", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70492024-08-27T19:09:00.524ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.383422ms iteration = 14 status = {}
70502024-08-27T19:09:00.530ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70512024-08-27T19:09:00.530ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55410b0c-b962-4364-a6f2-df825c276514", "content-length": "810", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70522024-08-27T19:09:00.530ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), vni: Vni(5493020) }} sled = buskin
70532024-08-27T19:09:00.530ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70542024-08-27T19:09:00.530ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70552024-08-27T19:09:00.532ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 310.006027ms iteration = 14 status = {}
70562024-08-27T19:09:00.573ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70572024-08-27T19:09:00.574ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "184eebdd-65af-4510-80ec-ad8bb6e7f956", "content-length": "1", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70582024-08-27T19:09:00.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70592024-08-27T19:09:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70602024-08-27T19:09:00.578ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 356.194601ms iteration = 14 status = null
70612024-08-27T19:09:00.590ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 368.049492ms iteration = 14 status = {}
70622024-08-27T19:09:00.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70632024-08-27T19:09:00.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70642024-08-27T19:09:00.634ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
70652024-08-27T19:09:00.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70662024-08-27T19:09:00.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70672024-08-27T19:09:00.642ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70682024-08-27T19:09:00.642ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "609f5ae4-04fb-4cca-9c75-7ece12eb2975", "content-length": "121", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70692024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
70702024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
70712024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70722024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70732024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
70742024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
70752024-08-27T19:09:00.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
70762024-08-27T19:09:00.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70772024-08-27T19:09:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70782024-08-27T19:09:00.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70792024-08-27T19:09:00.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07e59bc6-3ea9-49d2-8fd1-49c2b556e115", "content-length": "2", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70802024-08-27T19:09:00.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70812024-08-27T19:09:00.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d61d397e-0d0e-4888-9144-e013f6b2707e", "content-length": "52", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70822024-08-27T19:09:00.644ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
70832024-08-27T19:09:00.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70842024-08-27T19:09:00.740ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eca1ec4f-396a-4383-89e4-362cf25be154", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70852024-08-27T19:09:00.740ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
70862024-08-27T19:09:00.740ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70872024-08-27T19:09:00.740ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b18bf149-12e1-42f4-8913-25a3b2580237", "content-length": "667", "date": "Tue, 27 Aug 2024 19:09:00 GMT"} })
70882024-08-27T19:09:00.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70892024-08-27T19:09:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70902024-08-27T19:09:00.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70912024-08-27T19:09:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70922024-08-27T19:09:00.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70932024-08-27T19:09:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70942024-08-27T19:09:00.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70952024-08-27T19:09:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70962024-08-27T19:09:00.755ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 533.05373ms iteration = 14 status = {}
70972024-08-27T19:09:00.976ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 6d2d19d4-aaff-4e87-81c4-378b6b5f15da response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
70982024-08-27T19:09:01.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7875a097-95f5-4ec1-a260-69fc7ff2e597 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
70992024-08-27T19:09:01.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7875a097-95f5-4ec1-a260-69fc7ff2e597 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71002024-08-27T19:09:01.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7875a097-95f5-4ec1-a260-69fc7ff2e597 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71012024-08-27T19:09:02.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d26a4588-1449-4f0d-9c40-ae8e6a051d30 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71022024-08-27T19:09:02.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d26a4588-1449-4f0d-9c40-ae8e6a051d30 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71032024-08-27T19:09:02.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d26a4588-1449-4f0d-9c40-ae8e6a051d30 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71042024-08-27T19:09:03.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ca2f042-bcd5-41fa-b83d-2bac83ac8199 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71052024-08-27T19:09:03.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ca2f042-bcd5-41fa-b83d-2bac83ac8199 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71062024-08-27T19:09:03.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ca2f042-bcd5-41fa-b83d-2bac83ac8199 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71072024-08-27T19:09:04.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 70cbedec-bbe6-4ac0-b12f-8891bbcdc18d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71082024-08-27T19:09:04.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 70cbedec-bbe6-4ac0-b12f-8891bbcdc18d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71092024-08-27T19:09:04.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 70cbedec-bbe6-4ac0-b12f-8891bbcdc18d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71102024-08-27T19:09:04.477ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14271bd4-610f-4aed-9108-fe796f7ebfd9", "content-length": "128", "date": "Tue, 27 Aug 2024 19:09:04 GMT"} })
71112024-08-27T19:09:04.479ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 state = Starting
71122024-08-27T19:09:04.482ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-27T19:08:56.365532Z }
71132024-08-27T19:09:04.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 roles = RoleSet { roles: {} }
71142024-08-27T19:09:04.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 resource = Database result = Ok(())
71152024-08-27T19:09:04.492ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
71162024-08-27T19:09:04.492ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.270152962s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
71172024-08-27T19:09:04.495ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 222497df-5226-48f0-9b2e-c68ac7c5bd1e uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-27T19:09:04.477098060Z }
71182024-08-27T19:09:04.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 222497df-5226-48f0-9b2e-c68ac7c5bd1e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71192024-08-27T19:09:04.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 222497df-5226-48f0-9b2e-c68ac7c5bd1e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71202024-08-27T19:09:04.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 31340 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 222497df-5226-48f0-9b2e-c68ac7c5bd1e response_code = 204 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71212024-08-27T19:09:04.518ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89d0ebb6-262e-4e88-84f2-3ee9bff97848 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-27T19:09:04.517367442Z }
71222024-08-27T19:09:04.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89d0ebb6-262e-4e88-84f2-3ee9bff97848 roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71232024-08-27T19:09:04.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89d0ebb6-262e-4e88-84f2-3ee9bff97848 resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71242024-08-27T19:09:04.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 18844 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 89d0ebb6-262e-4e88-84f2-3ee9bff97848 response_code = 204 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71252024-08-27T19:09:05.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6b92be2-4b9a-4ce5-ad6a-61e5bac8063d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71262024-08-27T19:09:05.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6b92be2-4b9a-4ce5-ad6a-61e5bac8063d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71272024-08-27T19:09:05.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6b92be2-4b9a-4ce5-ad6a-61e5bac8063d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71282024-08-27T19:09:06.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1a6f8f04-5f00-421a-9e45-b5e22818af28 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71292024-08-27T19:09:06.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1a6f8f04-5f00-421a-9e45-b5e22818af28 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71302024-08-27T19:09:06.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1a6f8f04-5f00-421a-9e45-b5e22818af28 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71312024-08-27T19:09:07.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49703e40-2c9e-4595-bffc-45e435c273ff roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71322024-08-27T19:09:07.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49703e40-2c9e-4595-bffc-45e435c273ff resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71332024-08-27T19:09:07.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 49703e40-2c9e-4595-bffc-45e435c273ff response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71342024-08-27T19:09:08.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6cdf556b-8be4-4e60-be84-b0432329442b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71352024-08-27T19:09:08.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6cdf556b-8be4-4e60-be84-b0432329442b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71362024-08-27T19:09:08.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6cdf556b-8be4-4e60-be84-b0432329442b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71372024-08-27T19:09:09.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e7258b10-c545-488c-8614-c0664b216734 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71382024-08-27T19:09:09.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e7258b10-c545-488c-8614-c0664b216734 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71392024-08-27T19:09:09.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e7258b10-c545-488c-8614-c0664b216734 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71402024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
71412024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
71422024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71432024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71442024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71452024-08-27T19:09:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71462024-08-27T19:09:10.221ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71472024-08-27T19:09:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71482024-08-27T19:09:10.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71492024-08-27T19:09:10.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.076283ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71502024-08-27T19:09:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71512024-08-27T19:09:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71522024-08-27T19:09:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71532024-08-27T19:09:10.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71542024-08-27T19:09:10.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71552024-08-27T19:09:10.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71562024-08-27T19:09:10.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
71572024-08-27T19:09:10.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71582024-08-27T19:09:10.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71592024-08-27T19:09:10.235ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
71602024-08-27T19:09:10.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.629189ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
71612024-08-27T19:09:10.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3744e7e9-d9cd-49af-aced-2b386a85ff8f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71622024-08-27T19:09:10.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3744e7e9-d9cd-49af-aced-2b386a85ff8f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71632024-08-27T19:09:10.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3744e7e9-d9cd-49af-aced-2b386a85ff8f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71642024-08-27T19:09:10.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1717 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = b3cd2eb3-dfda-4a35-9a2b-97c066ef26a7 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
71652024-08-27T19:09:11.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01d2b175-c342-46d1-9520-3ee9558e74fd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71662024-08-27T19:09:11.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01d2b175-c342-46d1-9520-3ee9558e74fd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71672024-08-27T19:09:11.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 01d2b175-c342-46d1-9520-3ee9558e74fd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71682024-08-27T19:09:12.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8288889-5e2d-4bed-8ed8-868df7e3cce9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71692024-08-27T19:09:12.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8288889-5e2d-4bed-8ed8-868df7e3cce9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71702024-08-27T19:09:12.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8288889-5e2d-4bed-8ed8-868df7e3cce9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71712024-08-27T19:09:13.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baf25f5b-36bc-41e5-8424-cf37042e3e80 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71722024-08-27T19:09:13.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baf25f5b-36bc-41e5-8424-cf37042e3e80 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71732024-08-27T19:09:13.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = baf25f5b-36bc-41e5-8424-cf37042e3e80 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71742024-08-27T19:09:13.690ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1214be8b-34c0-447a-a66b-c4a4bb914c12 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-27T19:09:13.690091352Z }
71752024-08-27T19:09:13.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1214be8b-34c0-447a-a66b-c4a4bb914c12 roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71762024-08-27T19:09:13.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1214be8b-34c0-447a-a66b-c4a4bb914c12 resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71772024-08-27T19:09:13.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 28350 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1214be8b-34c0-447a-a66b-c4a4bb914c12 response_code = 204 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71782024-08-27T19:09:14.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 65dbe717-9082-4c9b-a85b-4af896fd076d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
71792024-08-27T19:09:14.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 65dbe717-9082-4c9b-a85b-4af896fd076d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
71802024-08-27T19:09:14.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 65dbe717-9082-4c9b-a85b-4af896fd076d response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
71812024-08-27T19:09:14.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 201d1a74-80d3-4117-83e9-6cf5bb9476aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
71822024-08-27T19:09:14.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 201d1a74-80d3-4117-83e9-6cf5bb9476aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
71832024-08-27T19:09:14.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 201d1a74-80d3-4117-83e9-6cf5bb9476aa response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
71842024-08-27T19:09:14.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1182a434-e32d-4681-b58d-5951c79abadc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71852024-08-27T19:09:14.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1182a434-e32d-4681-b58d-5951c79abadc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71862024-08-27T19:09:14.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1182a434-e32d-4681-b58d-5951c79abadc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71872024-08-27T19:09:15.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 2ea4bc49-8df3-4688-b44a-96be9ac9b285 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
71882024-08-27T19:09:15.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 2ea4bc49-8df3-4688-b44a-96be9ac9b285 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
71892024-08-27T19:09:15.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 2ea4bc49-8df3-4688-b44a-96be9ac9b285 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
71902024-08-27T19:09:15.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af9b33b5-6b27-49cf-9075-572234c90760 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71912024-08-27T19:09:15.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af9b33b5-6b27-49cf-9075-572234c90760 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71922024-08-27T19:09:15.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af9b33b5-6b27-49cf-9075-572234c90760 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
71932024-08-27T19:09:16.124ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T19:09:16.124163413Z }
71942024-08-27T19:09:16.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71952024-08-27T19:09:16.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71962024-08-27T19:09:16.139ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_needs_update = true
71972024-08-27T19:09:16.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71982024-08-27T19:09:16.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
71992024-08-27T19:09:16.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72002024-08-27T19:09:16.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72012024-08-27T19:09:16.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72022024-08-27T19:09:16.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72032024-08-27T19:09:16.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72042024-08-27T19:09:16.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72052024-08-27T19:09:16.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72062024-08-27T19:09:16.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72072024-08-27T19:09:16.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72082024-08-27T19:09:16.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72092024-08-27T19:09:16.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72102024-08-27T19:09:16.155ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d5f4de10-86a1-47de-980c-717d10d0f131, lookup_type: ById(d5f4de10-86a1-47de-980c-717d10d0f131) }, key: 8683e81c-6acc-43da-b354-ef69ca6c8c85, lookup_type: ById(8683e81c-6acc-43da-b354-ef69ca6c8c85) }, key: ea15c85b-55e9-4411-b55c-111d2f3169a1, lookup_type: ById(ea15c85b-55e9-4411-b55c-111d2f3169a1) } result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72112024-08-27T19:09:16.165ZINFOnexus (dropshot_internal): starting update saga for ea15c85b-55e9-4411-b55c-111d2f3169a1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T19:09:16.124163413Z }
72122024-08-27T19:09:16.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40914 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 180b9e2a-beeb-4c3f-a75d-565bab8af36e response_code = 204 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72132024-08-27T19:09:16.165ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3ee1313-7907-4a7c-89e5-344243c6f3f8 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T19:09:16.124163413Z }
72142024-08-27T19:09:16.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3ee1313-7907-4a7c-89e5-344243c6f3f8 roles = RoleSet { roles: {} } uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72152024-08-27T19:09:16.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3ee1313-7907-4a7c-89e5-344243c6f3f8 resource = Database result = Ok(()) uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72162024-08-27T19:09:16.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3672 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e3ee1313-7907-4a7c-89e5-344243c6f3f8 response_code = 204 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
72172024-08-27T19:09:16.169ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update
72182024-08-27T19:09:16.171ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"ea15c85b-55e9-4411-b55c-111d2f3169a1","lookup_type":{"ById":"ea15c85b-55e9-4411-b55c-111d2f3169a1"},"parent":{"key":"8683e81c-6acc-43da-b354-ef69ca6c8c85","lookup_type":{"ById":"8683e81c-6acc-43da-b354-ef69ca6c8c85"},"parent":{"key":"d5f4de10-86a1-47de-980c-717d10d0f131","lookup_type":{"ById":"d5f4de10-86a1-47de-980c-717d10d0f131"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72192024-08-27T19:09:16.171ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update
72202024-08-27T19:09:16.210ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update
72212024-08-27T19:09:16.211ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72222024-08-27T19:09:16.215ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72232024-08-27T19:09:16.215ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72242024-08-27T19:09:16.225ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72252024-08-27T19:09:16.225ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72262024-08-27T19:09:16.231ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72272024-08-27T19:09:16.231ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72282024-08-27T19:09:16.236ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72292024-08-27T19:09:16.236ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("da583580-f4c6-41c5-ab87-a0045d89869e")) node_id = 0 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72302024-08-27T19:09:16.241ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72312024-08-27T19:09:16.242ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72322024-08-27T19:09:16.252ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update
72332024-08-27T19:09:16.257ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72342024-08-27T19:09:16.257ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72352024-08-27T19:09:16.259ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72362024-08-27T19:09:16.259ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72372024-08-27T19:09:16.261ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72382024-08-27T19:09:16.261ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72392024-08-27T19:09:16.264ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72402024-08-27T19:09:16.264ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72412024-08-27T19:09:16.266ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72422024-08-27T19:09:16.266ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72432024-08-27T19:09:16.267ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72442024-08-27T19:09:16.267ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72452024-08-27T19:09:16.268ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72462024-08-27T19:09:16.271ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d5f4de10-86a1-47de-980c-717d10d0f131, lookup_type: ById(d5f4de10-86a1-47de-980c-717d10d0f131) }, key: 8683e81c-6acc-43da-b354-ef69ca6c8c85, lookup_type: ById(8683e81c-6acc-43da-b354-ef69ca6c8c85) }, key: ea15c85b-55e9-4411-b55c-111d2f3169a1, lookup_type: ById(ea15c85b-55e9-4411-b55c-111d2f3169a1) } result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72472024-08-27T19:09:16.271ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance updater_id = da583580-f4c6-41c5-ab87-a0045d89869e
72482024-08-27T19:09:16.271ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72492024-08-27T19:09:16.271ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72502024-08-27T19:09:16.285ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance updater_id = da583580-f4c6-41c5-ab87-a0045d89869e
72512024-08-27T19:09:16.285ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72522024-08-27T19:09:16.285ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance
72532024-08-27T19:09:16.288ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 locked_gen = Generation(Generation(2)) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = LockInstance updater_id = da583580-f4c6-41c5-ab87-a0045d89869e
72542024-08-27T19:09:16.290ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72552024-08-27T19:09:16.290ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("da583580-f4c6-41c5-ab87-a0045d89869e")}) node_id = 1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72562024-08-27T19:09:16.294ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72572024-08-27T19:09:16.294ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
72582024-08-27T19:09:16.305ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72592024-08-27T19:09:16.305ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72602024-08-27T19:09:16.306ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72612024-08-27T19:09:16.306ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72622024-08-27T19:09:16.307ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72632024-08-27T19:09:16.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72642024-08-27T19:09:16.309ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72652024-08-27T19:09:16.312ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d5f4de10-86a1-47de-980c-717d10d0f131, lookup_type: ById(d5f4de10-86a1-47de-980c-717d10d0f131) }, key: 8683e81c-6acc-43da-b354-ef69ca6c8c85, lookup_type: ById(8683e81c-6acc-43da-b354-ef69ca6c8c85) }, key: ea15c85b-55e9-4411-b55c-111d2f3169a1, lookup_type: ById(ea15c85b-55e9-4411-b55c-111d2f3169a1) } result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72662024-08-27T19:09:16.312ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72672024-08-27T19:09:16.312ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
72682024-08-27T19:09:16.319ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: dd24bc72-91af-4d1d-b95a-7efe8169b70c, time_created: 2024-08-27T19:08:56.365532Z, time_deleted: None, instance_id: ea15c85b-55e9-4411-b55c-111d2f3169a1, sled_id: e38b401b-2d22-4589-ac73-fc644b0a15b2, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-27T19:09:16.124163Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-27T19:08:56.413010Z, gen: Generation(Generation(3)), propolis_id: Some(dd24bc72-91af-4d1d-b95a-7efe8169b70c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(dd24bc72-91af-4d1d-b95a-7efe8169b70c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-27T19:09:16.319474803Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
72692024-08-27T19:09:16.324ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72702024-08-27T19:09:16.324ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"ea15c85b-55e9-4411-b55c-111d2f3169a1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"dd24bc72-91af-4d1d-b95a-7efe8169b70c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"ea15c85b-55e9-4411-b55c-111d2f3169a1","lookup_type":{"ById":"ea15c85b-55e9-4411-b55c-111d2f3169a1"},"parent":{"key":"8683e81c-6acc-43da-b354-ef69ca6c8c85","lookup_type":{"ById":"8683e81c-6acc-43da-b354-ef69ca6c8c85"},"parent":{"key":"d5f4de10-86a1-47de-980c-717d10d0f131","lookup_type":{"ById":"d5f4de10-86a1-47de-980c-717d10d0f131"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"da583580-f4c6-41c5-ab87-a0045d89869e"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"8683e81c-6acc-43da-b354-ef69ca6c8c85","ram_diff":1073741824},"destroy_active_vmm":"dd24bc72-91af-4d1d-b95a-7efe8169b70c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-27T19:09:16.319474803Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72712024-08-27T19:09:16.324ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72722024-08-27T19:09:16.334ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72732024-08-27T19:09:16.334ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72742024-08-27T19:09:16.334ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72752024-08-27T19:09:16.334ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72762024-08-27T19:09:16.339ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72772024-08-27T19:09:16.339ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72782024-08-27T19:09:16.342ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72792024-08-27T19:09:16.342ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72802024-08-27T19:09:16.347ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72812024-08-27T19:09:16.347ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c18ee9af-62fa-480f-8ac7-81826ac79c40")) node_id = 0 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72822024-08-27T19:09:16.351ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72832024-08-27T19:09:16.351ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72842024-08-27T19:09:16.358ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 parent_lock = UpdaterLock { updater_id: da583580-f4c6-41c5-ab87-a0045d89869e, locked_gen: Generation(Generation(2)) } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72852024-08-27T19:09:16.358ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = BecomeUpdater
72862024-08-27T19:09:16.359ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = BecomeUpdater
72872024-08-27T19:09:16.373ZDEBGnexus (SagaExecutor): inherited lock from da583580-f4c6-41c5-ab87-a0045d89869e to c18ee9af-62fa-480f-8ac7-81826ac79c40 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = da583580-f4c6-41c5-ab87-a0045d89869e saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = BecomeUpdater updater_id = c18ee9af-62fa-480f-8ac7-81826ac79c40
72882024-08-27T19:09:16.373ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72892024-08-27T19:09:16.373ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72902024-08-27T19:09:16.373ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c18ee9af-62fa-480f-8ac7-81826ac79c40")}) node_id = 1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72912024-08-27T19:09:16.381ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72922024-08-27T19:09:16.381ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72932024-08-27T19:09:16.386ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72942024-08-27T19:09:16.386ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72952024-08-27T19:09:16.391ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
72962024-08-27T19:09:16.391ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
72972024-08-27T19:09:16.395ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
72982024-08-27T19:09:16.397ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1
72992024-08-27T19:09:16.397ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73002024-08-27T19:09:16.397ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73012024-08-27T19:09:16.399ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73022024-08-27T19:09:16.399ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73032024-08-27T19:09:16.408ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
73042024-08-27T19:09:16.408ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73052024-08-27T19:09:16.408ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UpdateNetworkConfig
73062024-08-27T19:09:16.410ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
73072024-08-27T19:09:16.410ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
73082024-08-27T19:09:16.410ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
73092024-08-27T19:09:16.411ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
73102024-08-27T19:09:16.412ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
73112024-08-27T19:09:16.412ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
73122024-08-27T19:09:16.412ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
73132024-08-27T19:09:16.419ZDEBGnexus: notifying dendrite of updates instance_id = Some(ea15c85b-55e9-4411-b55c-111d2f3169a1 (instance)) switch = switch0
73142024-08-27T19:09:16.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 86715750 } })
73152024-08-27T19:09:16.421ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
73162024-08-27T19:09:16.451ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73172024-08-27T19:09:16.451ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73182024-08-27T19:09:16.452ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8e9acb2-6e27-467f-9b2a-53fbfce71f42", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} })
73192024-08-27T19:09:16.452ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73202024-08-27T19:09:16.453ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73212024-08-27T19:09:16.482ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
73222024-08-27T19:09:16.483ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97c2fc59-7fba-4d53-a67d-336daec3f9f7", "content-length": "4", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} })
73232024-08-27T19:09:16.485ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73242024-08-27T19:09:16.485ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73252024-08-27T19:09:16.490ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73262024-08-27T19:09:16.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73272024-08-27T19:09:16.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
73282024-08-27T19:09:16.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
73292024-08-27T19:09:16.515ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-27T19:09:16.501992Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8683e81c-6acc-43da-b354-ef69ca6c8c85, time_modified: Some(2024-08-27T19:09:16.501992Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: d5f4de10-86a1-47de-980c-717d10d0f131, time_modified: Some(2024-08-27T19:09:16.501992Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73302024-08-27T19:09:16.515ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73312024-08-27T19:09:16.515ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73322024-08-27T19:09:16.521ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73332024-08-27T19:09:16.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73342024-08-27T19:09:16.529ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73352024-08-27T19:09:16.529ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UnassignOximeterProducer
73362024-08-27T19:09:16.529ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UnassignOximeterProducer
73372024-08-27T19:09:16.541ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 producer_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73382024-08-27T19:09:16.541ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UnassignOximeterProducer
73392024-08-27T19:09:16.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = UnassignOximeterProducer
73402024-08-27T19:09:16.576ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73412024-08-27T19:09:16.576ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/ea15c85b-55e9-4411-b55c-111d2f3169a1
73422024-08-27T19:09:16.577ZDEBGnexus (SagaExecutor): client response oximeter-collector = ea15c85b-55e9-4411-b55c-111d2f3169a1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/ea15c85b-55e9-4411-b55c-111d2f3169a1", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7665bacd-1a1e-4fa0-bef6-01af2851c712", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} }) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73432024-08-27T19:09:16.577ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 producer_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73442024-08-27T19:09:16.578ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73452024-08-27T19:09:16.578ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73462024-08-27T19:09:16.584ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73472024-08-27T19:09:16.584ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73482024-08-27T19:09:16.589ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 lock = UpdaterLock { updater_id: c18ee9af-62fa-480f-8ac7-81826ac79c40, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-27T19:09:16.319474803Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73492024-08-27T19:09:16.589ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73502024-08-27T19:09:16.589ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73512024-08-27T19:09:16.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e775752-d33b-4017-85e0-844f4f4b2dc1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
73522024-08-27T19:09:16.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e775752-d33b-4017-85e0-844f4f4b2dc1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
73532024-08-27T19:09:16.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2e775752-d33b-4017-85e0-844f4f4b2dc1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
73542024-08-27T19:09:16.645ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 new_runtime = InstanceRuntimeState { time_updated: 2024-08-27T19:09:16.319474803Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
73552024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
73562024-08-27T19:09:16.645ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73572024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73582024-08-27T19:09:16.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73592024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73602024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Signaled
73612024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73622024-08-27T19:09:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73632024-08-27T19:09:16.646ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73642024-08-27T19:09:16.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73652024-08-27T19:09:16.647ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73662024-08-27T19:09:16.648ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73672024-08-27T19:09:16.648ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73682024-08-27T19:09:16.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73692024-08-27T19:09:16.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73702024-08-27T19:09:16.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73712024-08-27T19:09:16.649ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73722024-08-27T19:09:16.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73732024-08-27T19:09:16.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73742024-08-27T19:09:16.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73752024-08-27T19:09:16.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73762024-08-27T19:09:16.652ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d5f4de10-86a1-47de-980c-717d10d0f131, lookup_type: ById(d5f4de10-86a1-47de-980c-717d10d0f131) }, key: 8683e81c-6acc-43da-b354-ef69ca6c8c85, lookup_type: ById(8683e81c-6acc-43da-b354-ef69ca6c8c85) }, key: ea15c85b-55e9-4411-b55c-111d2f3169a1, lookup_type: ById(ea15c85b-55e9-4411-b55c-111d2f3169a1) } result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73772024-08-27T19:09:16.652ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73782024-08-27T19:09:16.652ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = CommitInstanceUpdates
73792024-08-27T19:09:16.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73802024-08-27T19:09:16.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73812024-08-27T19:09:16.656ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73822024-08-27T19:09:16.656ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73832024-08-27T19:09:16.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73842024-08-27T19:09:16.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73852024-08-27T19:09:16.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73862024-08-27T19:09:16.664ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73872024-08-27T19:09:16.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73882024-08-27T19:09:16.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73892024-08-27T19:09:16.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73902024-08-27T19:09:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73912024-08-27T19:09:16.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73922024-08-27T19:09:16.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73932024-08-27T19:09:16.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73942024-08-27T19:09:16.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73952024-08-27T19:09:16.671ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73962024-08-27T19:09:16.671ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("ea15c85b-55e9-4411-b55c-111d2f3169a1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dd24bc72-91af-4d1d-b95a-7efe8169b70c")}) node_id = 7 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73972024-08-27T19:09:16.675ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
73982024-08-27T19:09:16.675ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
73992024-08-27T19:09:16.680ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74002024-08-27T19:09:16.680ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74012024-08-27T19:09:16.685ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74022024-08-27T19:09:16.685ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74032024-08-27T19:09:16.689ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
74042024-08-27T19:09:16.689ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = ReleaseSledResources
74052024-08-27T19:09:16.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = ReleaseSledResources
74062024-08-27T19:09:16.697ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74072024-08-27T19:09:16.697ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b940fb18-6540-4647-84f0-188939cf825f", "content-length": "372", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} })
74082024-08-27T19:09:16.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74092024-08-27T19:09:16.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74102024-08-27T19:09:16.699ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74112024-08-27T19:09:16.699ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74122024-08-27T19:09:16.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74132024-08-27T19:09:16.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74142024-08-27T19:09:16.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74152024-08-27T19:09:16.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74162024-08-27T19:09:16.703ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74172024-08-27T19:09:16.704ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f160172d-e0cc-4bdd-a7f7-7a4ad2618da7", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} })
74182024-08-27T19:09:16.704ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74192024-08-27T19:09:16.704ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74202024-08-27T19:09:16.705ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 59.932783ms iteration = 15 status = {}
74212024-08-27T19:09:16.709ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update
74222024-08-27T19:09:16.710ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = MarkVmmDeleted
74232024-08-27T19:09:16.710ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_node = MarkVmmDeleted
74242024-08-27T19:09:16.715ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74252024-08-27T19:09:16.716ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c0b4043-e4f9-4872-9efa-cbf3e7e2f447", "content-length": "691", "date": "Tue, 27 Aug 2024 19:09:16 GMT"} })
74262024-08-27T19:09:16.716ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74272024-08-27T19:09:16.716ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74282024-08-27T19:09:16.716ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74292024-08-27T19:09:16.717ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 72.649172ms iteration = 15 status = {}
74302024-08-27T19:09:16.732ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74312024-08-27T19:09:16.732ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74322024-08-27T19:09:16.739ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74332024-08-27T19:09:16.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74342024-08-27T19:09:16.742ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74352024-08-27T19:09:16.742ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74362024-08-27T19:09:16.747ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74372024-08-27T19:09:16.747ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74382024-08-27T19:09:16.752ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74392024-08-27T19:09:16.753ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74402024-08-27T19:09:16.756ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74412024-08-27T19:09:16.756ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d
74422024-08-27T19:09:16.767ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74432024-08-27T19:09:16.767ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d saga_name = instance-update saga_result = SagaResult { saga_id: 5e3e811a-6f23-4512-bef2-c343e38c235d, saga_log: SagaLog { saga_id: 5e3e811a-6f23-4512-bef2-c343e38c235d, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("c18ee9af-62fa-480f-8ac7-81826ac79c40")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c18ee9af-62fa-480f-8ac7-81826ac79c40")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("ea15c85b-55e9-4411-b55c-111d2f3169a1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dd24bc72-91af-4d1d-b95a-7efe8169b70c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("ea15c85b-55e9-4411-b55c-111d2f3169a1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("dd24bc72-91af-4d1d-b95a-7efe8169b70c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c18ee9af-62fa-480f-8ac7-81826ac79c40"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c18ee9af-62fa-480f-8ac7-81826ac79c40")}} }) }
74442024-08-27T19:09:16.767ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 5e3e811a-6f23-4512-bef2-c343e38c235d instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update
74452024-08-27T19:09:16.767ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74462024-08-27T19:09:16.767ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
74472024-08-27T19:09:16.771ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74482024-08-27T19:09:16.771ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
74492024-08-27T19:09:16.776ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74502024-08-27T19:09:16.776ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
74512024-08-27T19:09:16.781ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74522024-08-27T19:09:16.781ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8
74532024-08-27T19:09:16.814ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update sec_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
74542024-08-27T19:09:16.814ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 2edae4be-1215-4b5e-8665-9a4427258fc8 saga_name = start-instance-update saga_result = SagaResult { saga_id: 2edae4be-1215-4b5e-8665-9a4427258fc8, saga_log: SagaLog { saga_id: 2edae4be-1215-4b5e-8665-9a4427258fc8, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("da583580-f4c6-41c5-ab87-a0045d89869e")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("da583580-f4c6-41c5-ab87-a0045d89869e")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("da583580-f4c6-41c5-ab87-a0045d89869e"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("da583580-f4c6-41c5-ab87-a0045d89869e")}} }) }
74552024-08-27T19:09:17.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e4329939-ca58-40aa-a876-c8f1a2169140 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
74562024-08-27T19:09:17.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e4329939-ca58-40aa-a876-c8f1a2169140 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
74572024-08-27T19:09:17.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = e4329939-ca58-40aa-a876-c8f1a2169140 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
74582024-08-27T19:09:17.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 42307d40-b0cd-4804-95b1-84397209b95e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74592024-08-27T19:09:17.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 42307d40-b0cd-4804-95b1-84397209b95e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74602024-08-27T19:09:17.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 42307d40-b0cd-4804-95b1-84397209b95e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74612024-08-27T19:09:18.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 14c8c029-b744-419a-a8e8-8709289349de roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
74622024-08-27T19:09:18.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 14c8c029-b744-419a-a8e8-8709289349de resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
74632024-08-27T19:09:18.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 14c8c029-b744-419a-a8e8-8709289349de response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
74642024-08-27T19:09:18.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f33bff-2d09-4f2f-8ce0-631ad787245f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74652024-08-27T19:09:18.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f33bff-2d09-4f2f-8ce0-631ad787245f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74662024-08-27T19:09:18.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28f33bff-2d09-4f2f-8ce0-631ad787245f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74672024-08-27T19:09:19.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a4b6a573-3da4-4991-86da-a3a12fb82f8a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74682024-08-27T19:09:19.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a4b6a573-3da4-4991-86da-a3a12fb82f8a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74692024-08-27T19:09:19.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a4b6a573-3da4-4991-86da-a3a12fb82f8a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74702024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
74712024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
74722024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74732024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74752024-08-27T19:09:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74762024-08-27T19:09:20.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-08-27T19:09:20.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74782024-08-27T19:09:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74792024-08-27T19:09:20.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.135595ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74802024-08-27T19:09:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74812024-08-27T19:09:20.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74822024-08-27T19:09:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74832024-08-27T19:09:20.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74842024-08-27T19:09:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74852024-08-27T19:09:20.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74862024-08-27T19:09:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
74872024-08-27T19:09:20.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74882024-08-27T19:09:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74892024-08-27T19:09:20.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
74902024-08-27T19:09:20.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.264231ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
74912024-08-27T19:09:20.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d663f98a-8686-488d-b477-fac7d252e1a5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74922024-08-27T19:09:20.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d663f98a-8686-488d-b477-fac7d252e1a5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74932024-08-27T19:09:20.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d663f98a-8686-488d-b477-fac7d252e1a5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74942024-08-27T19:09:20.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1103 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = f12f4ced-86c0-4b27-881b-5f44e80c8935 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
74952024-08-27T19:09:21.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69033b77-ffe2-43e6-beca-d511efceafbc roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74962024-08-27T19:09:21.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69033b77-ffe2-43e6-beca-d511efceafbc resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74972024-08-27T19:09:21.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 69033b77-ffe2-43e6-beca-d511efceafbc response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74982024-08-27T19:09:22.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c828d3ac-37b8-4c1c-843f-44928c83eb0b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
74992024-08-27T19:09:22.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c828d3ac-37b8-4c1c-843f-44928c83eb0b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75002024-08-27T19:09:22.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c828d3ac-37b8-4c1c-843f-44928c83eb0b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75012024-08-27T19:09:23.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e7f3829-f555-42e2-893a-0456e9e9673f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75022024-08-27T19:09:23.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e7f3829-f555-42e2-893a-0456e9e9673f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75032024-08-27T19:09:23.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4e7f3829-f555-42e2-893a-0456e9e9673f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75042024-08-27T19:09:24.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ecec413d-1654-43a5-855b-1f58ef6ad35d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75052024-08-27T19:09:24.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ecec413d-1654-43a5-855b-1f58ef6ad35d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75062024-08-27T19:09:24.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ecec413d-1654-43a5-855b-1f58ef6ad35d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75072024-08-27T19:09:25.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9e65bff4-e700-4de8-a3d0-6b905dbd9051 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75082024-08-27T19:09:25.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9e65bff4-e700-4de8-a3d0-6b905dbd9051 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75092024-08-27T19:09:25.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9e65bff4-e700-4de8-a3d0-6b905dbd9051 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75102024-08-27T19:09:26.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b6530c3-9766-40be-9cee-51d2cfd6eb9a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75112024-08-27T19:09:26.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b6530c3-9766-40be-9cee-51d2cfd6eb9a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75122024-08-27T19:09:26.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b6530c3-9766-40be-9cee-51d2cfd6eb9a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75132024-08-27T19:09:27.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b0ed0b79-cf10-4182-adf1-7f7ede58d810 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75142024-08-27T19:09:27.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b0ed0b79-cf10-4182-adf1-7f7ede58d810 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75152024-08-27T19:09:27.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b0ed0b79-cf10-4182-adf1-7f7ede58d810 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75162024-08-27T19:09:28.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e47ad7f-5cde-4bbb-9651-bf94c6edb71c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75172024-08-27T19:09:28.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e47ad7f-5cde-4bbb-9651-bf94c6edb71c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75182024-08-27T19:09:28.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e47ad7f-5cde-4bbb-9651-bf94c6edb71c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75192024-08-27T19:09:29.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af4ddd47-8a70-4f57-a71f-022ee7aedfea roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75202024-08-27T19:09:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af4ddd47-8a70-4f57-a71f-022ee7aedfea resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75212024-08-27T19:09:29.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = af4ddd47-8a70-4f57-a71f-022ee7aedfea response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
75222024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
75232024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
75242024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75252024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
75262024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75272024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75282024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75292024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75302024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
75312024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75322024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75332024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75342024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75352024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75362024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
75372024-08-27T19:09:30.224ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75382024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75392024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
75402024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75412024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
75422024-08-27T19:09:30.224ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
75432024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75442024-08-27T19:09:30.225ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
75452024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75462024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.611\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
75472024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
75482024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
75492024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75502024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75512024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
75522024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
75532024-08-27T19:09:30.225ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 18:59:30.224758515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75542024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75552024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75562024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
75572024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75582024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
75592024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75602024-08-27T19:09:30.225ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
75612024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75622024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
75632024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
75642024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75652024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75662024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75672024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75682024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75692024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75702024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75712024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75722024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75732024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75742024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
75752024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75762024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75772024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
75782024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75792024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
75802024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75812024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
75822024-08-27T19:09:30.226ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
75832024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75842024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
75852024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75862024-08-27T19:09:30.226ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
75872024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75882024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
75892024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75902024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75912024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75922024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75932024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75942024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75952024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75962024-08-27T19:09:30.226ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 884187973 } })
75972024-08-27T19:09:30.226ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 884301915 } })
75982024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75992024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76002024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76012024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76022024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76032024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76042024-08-27T19:09:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76052024-08-27T19:09:30.227ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76062024-08-27T19:09:30.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.741976ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76072024-08-27T19:09:30.228ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
76082024-08-27T19:09:30.228ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.288227ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
76092024-08-27T19:09:30.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76102024-08-27T19:09:30.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76112024-08-27T19:09:30.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76122024-08-27T19:09:30.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-08-27T19:09:30.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142024-08-27T19:09:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76152024-08-27T19:09:30.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162024-08-27T19:09:30.232ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.520793ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76172024-08-27T19:09:30.232ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
76182024-08-27T19:09:30.232ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76192024-08-27T19:09:30.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76202024-08-27T19:09:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76212024-08-27T19:09:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76222024-08-27T19:09:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76232024-08-27T19:09:30.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76242024-08-27T19:09:30.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76252024-08-27T19:09:30.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76262024-08-27T19:09:30.234ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76272024-08-27T19:09:30.235ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
76282024-08-27T19:09:30.235ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76292024-08-27T19:09:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 10.507245ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
76302024-08-27T19:09:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.889282ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76312024-08-27T19:09:30.235ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 18:59:30.224758515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76322024-08-27T19:09:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.77506ms iteration = 8 status = {"expiration":"2024-08-27T18:59:30.224758515Z","pruned":[]}
76332024-08-27T19:09:30.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76342024-08-27T19:09:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76352024-08-27T19:09:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76362024-08-27T19:09:30.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76372024-08-27T19:09:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76382024-08-27T19:09:30.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76392024-08-27T19:09:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76402024-08-27T19:09:30.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76412024-08-27T19:09:30.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76422024-08-27T19:09:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76432024-08-27T19:09:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 13.138948ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
76442024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76452024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76462024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76472024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76482024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76492024-08-27T19:09:30.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76502024-08-27T19:09:30.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 897943554 } })
76512024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76522024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76532024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76542024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76552024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76562024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76572024-08-27T19:09:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76582024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76592024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76602024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76612024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76622024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76632024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76642024-08-27T19:09:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76652024-08-27T19:09:30.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
76662024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76672024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76682024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76692024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76702024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76712024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76722024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76732024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76742024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76752024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.432986ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
76762024-08-27T19:09:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76772024-08-27T19:09:30.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76782024-08-27T19:09:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76792024-08-27T19:09:30.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 901350163 } })
76802024-08-27T19:09:30.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
76812024-08-27T19:09:30.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76822024-08-27T19:09:30.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76832024-08-27T19:09:30.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76842024-08-27T19:09:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76852024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76862024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76872024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76882024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76892024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76902024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76912024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76922024-08-27T19:09:30.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76932024-08-27T19:09:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76942024-08-27T19:09:30.245ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
76952024-08-27T19:09:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 20.07507ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76962024-08-27T19:09:30.245ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76972024-08-27T19:09:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.708743ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
76982024-08-27T19:09:30.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76992024-08-27T19:09:30.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77002024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77012024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77022024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77032024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77042024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77052024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77062024-08-27T19:09:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77072024-08-27T19:09:30.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.787214ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77082024-08-27T19:09:30.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77092024-08-27T19:09:30.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 906300944 } })
77102024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77112024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77122024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77132024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77142024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77152024-08-27T19:09:30.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77162024-08-27T19:09:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77172024-08-27T19:09:30.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
77182024-08-27T19:09:30.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 24.737365ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
77192024-08-27T19:09:30.249ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
77202024-08-27T19:09:30.250ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
77212024-08-27T19:09:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.703144ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
77222024-08-27T19:09:30.250ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77232024-08-27T19:09:30.250ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77242024-08-27T19:09:30.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77252024-08-27T19:09:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77262024-08-27T19:09:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77272024-08-27T19:09:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77282024-08-27T19:09:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77292024-08-27T19:09:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77302024-08-27T19:09:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
77312024-08-27T19:09:30.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77322024-08-27T19:09:30.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77332024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77342024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77352024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77362024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77372024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
77382024-08-27T19:09:30.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77392024-08-27T19:09:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77402024-08-27T19:09:30.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77412024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77422024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77432024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77442024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77452024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77462024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77472024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77482024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.32103ms iteration = 17 status = {"physical_disks_added":0}
77492024-08-27T19:09:30.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77502024-08-27T19:09:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77512024-08-27T19:09:30.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77522024-08-27T19:09:30.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77532024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77542024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77552024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77562024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77572024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77582024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
77592024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77602024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
77612024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 35.094406ms iteration = 8 status = {"generation":1}
77622024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77632024-08-27T19:09:30.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77642024-08-27T19:09:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77652024-08-27T19:09:30.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77662024-08-27T19:09:30.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77672024-08-27T19:09:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77682024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77692024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
77702024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77712024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
77722024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 36.622977ms iteration = 8 status = {"generation":2}
77732024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
77752024-08-27T19:09:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.050836ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
77762024-08-27T19:09:30.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77772024-08-27T19:09:30.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77782024-08-27T19:09:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77792024-08-27T19:09:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
77802024-08-27T19:09:30.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77812024-08-27T19:09:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77822024-08-27T19:09:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.848934ms iteration = 15 status = 0
77832024-08-27T19:09:30.271ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
77842024-08-27T19:09:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 47.089061ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77852024-08-27T19:09:30.274ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77862024-08-27T19:09:30.274ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77872024-08-27T19:09:30.274ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 49.759646ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77882024-08-27T19:09:30.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
77892024-08-27T19:09:30.392ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77902024-08-27T19:09:30.392ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f5e5bbc-f1d7-42f0-b5b2-ab1525b59065", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
77912024-08-27T19:09:30.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77922024-08-27T19:09:30.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77932024-08-27T19:09:30.406ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
77942024-08-27T19:09:30.406ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77952024-08-27T19:09:30.406ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c02701b-7ed4-435a-bc95-ca9fca4bbaa3", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
77962024-08-27T19:09:30.406ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77972024-08-27T19:09:30.409ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77982024-08-27T19:09:30.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77992024-08-27T19:09:30.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78002024-08-27T19:09:30.520ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78012024-08-27T19:09:30.520ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1955a195-284d-4a81-bf87-44f70b2c0435", "content-length": "372", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78022024-08-27T19:09:30.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78032024-08-27T19:09:30.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78042024-08-27T19:09:30.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78052024-08-27T19:09:30.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78062024-08-27T19:09:30.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78072024-08-27T19:09:30.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78082024-08-27T19:09:30.527ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78092024-08-27T19:09:30.528ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "09c48f83-3720-4120-9a50-9de1d92e6acd", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78102024-08-27T19:09:30.529ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.031665ms iteration = 16 status = {}
78112024-08-27T19:09:30.535ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78122024-08-27T19:09:30.535ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4025b216-02a6-4145-9421-6f20b22a2915", "content-length": "691", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78132024-08-27T19:09:30.535ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78142024-08-27T19:09:30.535ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78152024-08-27T19:09:30.535ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78162024-08-27T19:09:30.536ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.861375ms iteration = 16 status = {}
78172024-08-27T19:09:30.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
78182024-08-27T19:09:30.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78192024-08-27T19:09:30.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b62882-8833-4922-a804-314bca0d2d91", "content-length": "26", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78202024-08-27T19:09:30.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78212024-08-27T19:09:30.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78222024-08-27T19:09:30.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
78232024-08-27T19:09:30.665ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.913899ms iteration = 15 status = {}
78242024-08-27T19:09:30.687ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78252024-08-27T19:09:30.688ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d1ffc7c-012d-4bf5-85eb-a3f857faeba8", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78262024-08-27T19:09:30.688ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78272024-08-27T19:09:30.689ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78282024-08-27T19:09:30.689ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7db2c180-ce4d-4395-9bb3-d306537963b6", "content-length": "2", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78292024-08-27T19:09:30.690ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6ed0a842-f196-4a39-ab9a-1fd681351e71", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78302024-08-27T19:09:30.690ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78312024-08-27T19:09:30.692ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78322024-08-27T19:09:30.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78332024-08-27T19:09:30.693ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78342024-08-27T19:09:30.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 470.406521ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78352024-08-27T19:09:30.694ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.476553ms iteration = 15 status = null
78362024-08-27T19:09:30.712ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78372024-08-27T19:09:30.712ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "704336b8-d692-43bc-84da-715a3b55c8b9", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78382024-08-27T19:09:30.712ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78392024-08-27T19:09:30.714ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba6eb835-5f7c-4374-907e-f6091ce5887a", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78402024-08-27T19:09:30.714ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78412024-08-27T19:09:30.715ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "936c09b4-94c9-4ec1-8353-00ac072941a6", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78422024-08-27T19:09:30.715ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78432024-08-27T19:09:30.717ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78442024-08-27T19:09:30.717ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 493.94063ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78452024-08-27T19:09:30.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78462024-08-27T19:09:30.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78472024-08-27T19:09:30.776ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
78482024-08-27T19:09:30.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78492024-08-27T19:09:30.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78502024-08-27T19:09:30.783ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78512024-08-27T19:09:30.784ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfe5466d-4138-48f2-bb1c-23bb096cf445", "content-length": "121", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78522024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
78532024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
78542024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78552024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78562024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
78572024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
78582024-08-27T19:09:30.784ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
78592024-08-27T19:09:30.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78602024-08-27T19:09:30.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78612024-08-27T19:09:30.785ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78622024-08-27T19:09:30.786ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "21c2c1ec-d030-4082-88f3-e5f541fc2d38", "content-length": "2", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78632024-08-27T19:09:30.786ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78642024-08-27T19:09:30.786ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e5e1b79-168f-4a37-9de0-ff3742472956", "content-length": "52", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78652024-08-27T19:09:30.786ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
78662024-08-27T19:09:30.786ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78672024-08-27T19:09:30.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f615da66-3fb3-4a1b-86c5-68678a987233", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78682024-08-27T19:09:30.874ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
78692024-08-27T19:09:30.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78702024-08-27T19:09:30.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fae1e147-39c9-4961-85af-bfd26a7d92e8", "content-length": "667", "date": "Tue, 27 Aug 2024 19:09:30 GMT"} })
78712024-08-27T19:09:30.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78722024-08-27T19:09:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78732024-08-27T19:09:30.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78742024-08-27T19:09:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78752024-08-27T19:09:30.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78762024-08-27T19:09:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78772024-08-27T19:09:30.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78782024-08-27T19:09:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78792024-08-27T19:09:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.930702ms iteration = 15 status = {}
78802024-08-27T19:09:30.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcb0a47f-cbb7-436c-9033-4aeb800a59f9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78812024-08-27T19:09:30.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcb0a47f-cbb7-436c-9033-4aeb800a59f9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78822024-08-27T19:09:30.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcb0a47f-cbb7-436c-9033-4aeb800a59f9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78832024-08-27T19:09:30.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = b434ddac-b66c-4c4b-9a3d-84b70d6575a0 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
78842024-08-27T19:09:31.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c8179b-c0b4-4816-ac3c-1e89a28ff415 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78852024-08-27T19:09:31.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c8179b-c0b4-4816-ac3c-1e89a28ff415 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78862024-08-27T19:09:31.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 29c8179b-c0b4-4816-ac3c-1e89a28ff415 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78872024-08-27T19:09:32.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58f6d21a-1986-4de5-b2ad-ffd6d2f422eb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78882024-08-27T19:09:32.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58f6d21a-1986-4de5-b2ad-ffd6d2f422eb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78892024-08-27T19:09:32.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 58f6d21a-1986-4de5-b2ad-ffd6d2f422eb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78902024-08-27T19:09:33.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4eca3f53-0741-4053-9b42-cf33d0d49a4c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78912024-08-27T19:09:33.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4eca3f53-0741-4053-9b42-cf33d0d49a4c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78922024-08-27T19:09:33.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4eca3f53-0741-4053-9b42-cf33d0d49a4c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78932024-08-27T19:09:34.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c83d36c-ef02-4897-b80f-8b1edf5a6ffe roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78942024-08-27T19:09:34.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c83d36c-ef02-4897-b80f-8b1edf5a6ffe resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78952024-08-27T19:09:34.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5c83d36c-ef02-4897-b80f-8b1edf5a6ffe response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78962024-08-27T19:09:36.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2ba1663-7476-4d11-aaec-467ae668a49f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78972024-08-27T19:09:36.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2ba1663-7476-4d11-aaec-467ae668a49f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78982024-08-27T19:09:36.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2ba1663-7476-4d11-aaec-467ae668a49f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
78992024-08-27T19:09:37.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c755886e-d900-4149-aa49-0d72b4914587 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79002024-08-27T19:09:37.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c755886e-d900-4149-aa49-0d72b4914587 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79012024-08-27T19:09:37.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c755886e-d900-4149-aa49-0d72b4914587 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79022024-08-27T19:09:38.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 54cdf063-6227-4d6f-b196-52cbe2a6c872 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79032024-08-27T19:09:38.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 54cdf063-6227-4d6f-b196-52cbe2a6c872 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79042024-08-27T19:09:38.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 54cdf063-6227-4d6f-b196-52cbe2a6c872 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79052024-08-27T19:09:39.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93561860-8c72-4021-bbc6-4379c8517bb1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79062024-08-27T19:09:39.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93561860-8c72-4021-bbc6-4379c8517bb1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79072024-08-27T19:09:39.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93561860-8c72-4021-bbc6-4379c8517bb1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79082024-08-27T19:09:40.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c1b8e3d4-6ff8-4dc8-802e-c723fd5c4b65 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79092024-08-27T19:09:40.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c1b8e3d4-6ff8-4dc8-802e-c723fd5c4b65 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79102024-08-27T19:09:40.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c1b8e3d4-6ff8-4dc8-802e-c723fd5c4b65 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79112024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
79122024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
79132024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79142024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79152024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79162024-08-27T19:09:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79172024-08-27T19:09:40.221ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79182024-08-27T19:09:40.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79192024-08-27T19:09:40.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79202024-08-27T19:09:40.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.125313ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79212024-08-27T19:09:40.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79222024-08-27T19:09:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79232024-08-27T19:09:40.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79242024-08-27T19:09:40.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79252024-08-27T19:09:40.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79262024-08-27T19:09:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272024-08-27T19:09:40.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
79282024-08-27T19:09:40.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79292024-08-27T19:09:40.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79302024-08-27T19:09:40.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
79312024-08-27T19:09:40.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.487466ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
79322024-08-27T19:09:40.974ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 510 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = c6a11f66-7310-4dfd-af94-848eb1b12f9c response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
79332024-08-27T19:09:41.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2897ba3-0e5d-44e3-a1fa-b7b19a469f3c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79342024-08-27T19:09:41.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2897ba3-0e5d-44e3-a1fa-b7b19a469f3c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79352024-08-27T19:09:41.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e2897ba3-0e5d-44e3-a1fa-b7b19a469f3c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79362024-08-27T19:09:42.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2e530e7-df63-4eca-bc9c-9eace4b2ce05 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79372024-08-27T19:09:42.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2e530e7-df63-4eca-bc9c-9eace4b2ce05 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79382024-08-27T19:09:42.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c2e530e7-df63-4eca-bc9c-9eace4b2ce05 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79392024-08-27T19:09:43.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e1c6d60b-b605-4484-bf43-d9fd253447e0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79402024-08-27T19:09:43.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e1c6d60b-b605-4484-bf43-d9fd253447e0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79412024-08-27T19:09:43.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = e1c6d60b-b605-4484-bf43-d9fd253447e0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79422024-08-27T19:09:44.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b13aead-eaf6-4d90-adf5-5d030737d05a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79432024-08-27T19:09:44.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b13aead-eaf6-4d90-adf5-5d030737d05a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79442024-08-27T19:09:44.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1b13aead-eaf6-4d90-adf5-5d030737d05a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79452024-08-27T19:09:45.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1368e4df-013f-4521-a29f-5f922e144198 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79462024-08-27T19:09:45.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1368e4df-013f-4521-a29f-5f922e144198 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79472024-08-27T19:09:45.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1368e4df-013f-4521-a29f-5f922e144198 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79482024-08-27T19:09:46.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 20becbdd-0048-4440-b9ae-b70b7111c5f6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79492024-08-27T19:09:46.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 20becbdd-0048-4440-b9ae-b70b7111c5f6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79502024-08-27T19:09:46.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 20becbdd-0048-4440-b9ae-b70b7111c5f6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79512024-08-27T19:09:47.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 819915bb-2112-487a-905f-79d1d6c80dba roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79522024-08-27T19:09:47.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 819915bb-2112-487a-905f-79d1d6c80dba resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79532024-08-27T19:09:47.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 819915bb-2112-487a-905f-79d1d6c80dba response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79542024-08-27T19:09:48.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 4b3f5946-d6cd-453e-8499-c05d8164c50e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
79552024-08-27T19:09:48.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 4b3f5946-d6cd-453e-8499-c05d8164c50e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
79562024-08-27T19:09:48.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 4b3f5946-d6cd-453e-8499-c05d8164c50e response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
79572024-08-27T19:09:48.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf4d5dbd-eba1-42c1-81f5-691456ea587b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79582024-08-27T19:09:48.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf4d5dbd-eba1-42c1-81f5-691456ea587b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79592024-08-27T19:09:48.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf4d5dbd-eba1-42c1-81f5-691456ea587b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79602024-08-27T19:09:49.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 676038ef-2d5d-48b8-a4cc-3955ec7bef86 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79612024-08-27T19:09:49.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 676038ef-2d5d-48b8-a4cc-3955ec7bef86 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79622024-08-27T19:09:49.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 676038ef-2d5d-48b8-a4cc-3955ec7bef86 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79632024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
79642024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79652024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
79662024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79672024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79682024-08-27T19:09:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79692024-08-27T19:09:50.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79702024-08-27T19:09:50.228ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79712024-08-27T19:09:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79722024-08-27T19:09:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.385209ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79732024-08-27T19:09:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79742024-08-27T19:09:50.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79752024-08-27T19:09:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79762024-08-27T19:09:50.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79772024-08-27T19:09:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79782024-08-27T19:09:50.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79792024-08-27T19:09:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
79802024-08-27T19:09:50.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79812024-08-27T19:09:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79822024-08-27T19:09:50.241ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
79832024-08-27T19:09:50.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.285332ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
79842024-08-27T19:09:50.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28903cc0-9ba2-49d1-a174-7aca8ccf02b8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79852024-08-27T19:09:50.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28903cc0-9ba2-49d1-a174-7aca8ccf02b8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79862024-08-27T19:09:50.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28903cc0-9ba2-49d1-a174-7aca8ccf02b8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79872024-08-27T19:09:50.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 3fe8edca-cdc2-4c77-a365-a008d53eb803 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
79882024-08-27T19:09:51.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b38f8ead-05d7-4392-abf8-3614ef4001f6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79892024-08-27T19:09:51.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b38f8ead-05d7-4392-abf8-3614ef4001f6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79902024-08-27T19:09:51.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b38f8ead-05d7-4392-abf8-3614ef4001f6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79912024-08-27T19:09:52.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4cab1e36-8fc1-4708-b0b7-85222896075a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79922024-08-27T19:09:52.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4cab1e36-8fc1-4708-b0b7-85222896075a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79932024-08-27T19:09:52.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4cab1e36-8fc1-4708-b0b7-85222896075a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79942024-08-27T19:09:53.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cde2cf86-0e73-49b2-aeba-01de3b1a63f0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79952024-08-27T19:09:53.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cde2cf86-0e73-49b2-aeba-01de3b1a63f0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79962024-08-27T19:09:53.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = cde2cf86-0e73-49b2-aeba-01de3b1a63f0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79972024-08-27T19:09:54.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e3a474a-7cb1-4252-9e12-ad877941faec roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79982024-08-27T19:09:54.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e3a474a-7cb1-4252-9e12-ad877941faec resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
79992024-08-27T19:09:54.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e3a474a-7cb1-4252-9e12-ad877941faec response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80002024-08-27T19:09:55.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 685a988e-15fc-4198-854f-5345b48438e8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80012024-08-27T19:09:55.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 685a988e-15fc-4198-854f-5345b48438e8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80022024-08-27T19:09:55.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 685a988e-15fc-4198-854f-5345b48438e8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80032024-08-27T19:09:56.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b60459da-9f51-4054-a9bd-e58ce54f5211 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80042024-08-27T19:09:56.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b60459da-9f51-4054-a9bd-e58ce54f5211 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80052024-08-27T19:09:56.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b60459da-9f51-4054-a9bd-e58ce54f5211 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80062024-08-27T19:09:57.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 31694ece-ca01-40a2-8f88-9e83865a50ea roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80072024-08-27T19:09:57.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 31694ece-ca01-40a2-8f88-9e83865a50ea resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80082024-08-27T19:09:57.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 31694ece-ca01-40a2-8f88-9e83865a50ea response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80092024-08-27T19:09:58.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ada720eb-ef2f-4e57-a5bc-10e138a26e1e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80102024-08-27T19:09:58.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ada720eb-ef2f-4e57-a5bc-10e138a26e1e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80112024-08-27T19:09:58.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ada720eb-ef2f-4e57-a5bc-10e138a26e1e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80122024-08-27T19:09:59.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 007b7c64-b7df-42e7-9f9f-abbfdf98bbf6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80132024-08-27T19:09:59.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 007b7c64-b7df-42e7-9f9f-abbfdf98bbf6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80142024-08-27T19:09:59.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 007b7c64-b7df-42e7-9f9f-abbfdf98bbf6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
80152024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
80162024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
80172024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80182024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80192024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
80202024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80212024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
80222024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
80232024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80242024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80252024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
80262024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
80272024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80282024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80292024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
80302024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80312024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
80322024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80332024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
80342024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80352024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
80362024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80372024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
80382024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80392024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80402024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80412024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80422024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80432024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80442024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80452024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80462024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80472024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80482024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80492024-08-27T19:10:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80502024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
80512024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
80522024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80532024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80542024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
80552024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80562024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
80572024-08-27T19:10:00.228ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
80582024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80592024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80602024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80612024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80622024-08-27T19:10:00.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80632024-08-27T19:10:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80642024-08-27T19:10:00.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80652024-08-27T19:10:00.229ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.687295ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80662024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80672024-08-27T19:10:00.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 886688727 } })
80682024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80692024-08-27T19:10:00.230ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80702024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80712024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80722024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80732024-08-27T19:10:00.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
80742024-08-27T19:10:00.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80752024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80762024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.550962ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
80772024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80782024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80792024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80802024-08-27T19:10:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80812024-08-27T19:10:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.800138ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80822024-08-27T19:10:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80832024-08-27T19:10:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80842024-08-27T19:10:00.232ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 888677647 } })
80852024-08-27T19:10:00.232ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80862024-08-27T19:10:00.232ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80872024-08-27T19:10:00.232ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.523293ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
80882024-08-27T19:10:00.232ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
80892024-08-27T19:10:00.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80902024-08-27T19:10:00.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.224827ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
80912024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80922024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80932024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80942024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80952024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80962024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80972024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80982024-08-27T19:10:00.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80992024-08-27T19:10:00.234ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 891031375 } })
81002024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81012024-08-27T19:10:00.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
81022024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81032024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81042024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81052024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81062024-08-27T19:10:00.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81072024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81082024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81092024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81102024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81112024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81122024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81132024-08-27T19:10:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81142024-08-27T19:10:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81152024-08-27T19:10:00.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-08-27T19:10:00.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81172024-08-27T19:10:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81182024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81192024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81202024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81212024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81222024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81232024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81242024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81252024-08-27T19:10:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81262024-08-27T19:10:00.239ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
81272024-08-27T19:10:00.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.638157ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81282024-08-27T19:10:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81292024-08-27T19:10:00.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81302024-08-27T19:10:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81312024-08-27T19:10:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
81322024-08-27T19:10:00.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81332024-08-27T19:10:00.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81342024-08-27T19:10:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81352024-08-27T19:10:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81362024-08-27T19:10:00.241ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81372024-08-27T19:10:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.323703ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81382024-08-27T19:10:00.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.428064ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81392024-08-27T19:10:00.246ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
81402024-08-27T19:10:00.246ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.197642ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
81412024-08-27T19:10:00.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81422024-08-27T19:10:00.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81432024-08-27T19:10:00.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81442024-08-27T19:10:00.249ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.432708ms iteration = 18 status = {"physical_disks_added":0}
81452024-08-27T19:10:00.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81462024-08-27T19:10:00.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81472024-08-27T19:10:00.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81482024-08-27T19:10:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81492024-08-27T19:10:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81502024-08-27T19:10:00.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81512024-08-27T19:10:00.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522024-08-27T19:10:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81532024-08-27T19:10:00.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81542024-08-27T19:10:00.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81552024-08-27T19:10:00.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81562024-08-27T19:10:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81572024-08-27T19:10:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
81582024-08-27T19:10:00.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81592024-08-27T19:10:00.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81602024-08-27T19:10:00.256ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 28.791538ms iteration = 16 status = 0
81612024-08-27T19:10:00.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81622024-08-27T19:10:00.333ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81632024-08-27T19:10:00.334ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fcdb8ff0-da82-475a-acec-0d294ec37ccf", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81642024-08-27T19:10:00.335ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81652024-08-27T19:10:00.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81662024-08-27T19:10:00.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
81672024-08-27T19:10:00.344ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81682024-08-27T19:10:00.345ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95d1bc79-099b-4bd8-818f-48751b5a356c", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81692024-08-27T19:10:00.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81702024-08-27T19:10:00.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81712024-08-27T19:10:00.345ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81722024-08-27T19:10:00.345ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df73d624-c727-4d5a-b65f-ff8fac0c4fa4", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81732024-08-27T19:10:00.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81742024-08-27T19:10:00.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
81752024-08-27T19:10:00.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81762024-08-27T19:10:00.354ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81772024-08-27T19:10:00.355ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0f1557c-9b97-4742-9a30-6c307fc1d2d9", "content-length": "372", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81782024-08-27T19:10:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81792024-08-27T19:10:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81802024-08-27T19:10:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81812024-08-27T19:10:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81822024-08-27T19:10:00.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81832024-08-27T19:10:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81842024-08-27T19:10:00.361ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81852024-08-27T19:10:00.362ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e31de3a-bbdc-4f83-bd1f-170e680208ff", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81862024-08-27T19:10:00.363ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 135.357763ms iteration = 17 status = {}
81872024-08-27T19:10:00.372ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81882024-08-27T19:10:00.372ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d69187-c17f-4385-9929-67a80e486767", "content-length": "691", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
81892024-08-27T19:10:00.372ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81902024-08-27T19:10:00.372ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81912024-08-27T19:10:00.372ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81922024-08-27T19:10:00.373ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 146.260315ms iteration = 17 status = {}
81932024-08-27T19:10:00.425ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.393569ms iteration = 16 status = {}
81942024-08-27T19:10:00.431ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81952024-08-27T19:10:00.431ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4f861a9f-bf53-4c84-bad8-60a4874fcf3f", "content-length": "2", "date": "Tue, 27 Aug 2024 19:09:59 GMT"} })
81962024-08-27T19:10:00.433ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81972024-08-27T19:10:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81982024-08-27T19:10:00.434ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 207.301131ms iteration = 16 status = null
81992024-08-27T19:10:00.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82002024-08-27T19:10:00.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82012024-08-27T19:10:00.495ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
82022024-08-27T19:10:00.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82032024-08-27T19:10:00.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82042024-08-27T19:10:00.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82052024-08-27T19:10:00.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "abdb0808-f2cd-4e3a-85bb-11a732389906", "content-length": "121", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
82062024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
82072024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
82082024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82092024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82102024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
82112024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
82122024-08-27T19:10:00.502ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
82132024-08-27T19:10:00.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82142024-08-27T19:10:00.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82152024-08-27T19:10:00.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82162024-08-27T19:10:00.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a0f0283-1da6-4e42-951b-532a985999fa", "content-length": "2", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
82172024-08-27T19:10:00.505ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82182024-08-27T19:10:00.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17ad1b38-f431-4fb9-9d7c-005352704ae9", "content-length": "52", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
82192024-08-27T19:10:00.505ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
82202024-08-27T19:10:00.505ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82212024-08-27T19:10:00.603ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "31c569bc-c046-46d2-b23c-a17b4b3167c8", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
82222024-08-27T19:10:00.603ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
82232024-08-27T19:10:00.603ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82242024-08-27T19:10:00.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 291036a2-bdba-425d-a894-4221fb0d694f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82252024-08-27T19:10:00.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 291036a2-bdba-425d-a894-4221fb0d694f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82262024-08-27T19:10:00.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 291036a2-bdba-425d-a894-4221fb0d694f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82272024-08-27T19:10:00.611ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5470dd0-d144-40d4-b670-9cd31d03e415", "content-length": "667", "date": "Tue, 27 Aug 2024 19:10:00 GMT"} })
82282024-08-27T19:10:00.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82292024-08-27T19:10:00.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82302024-08-27T19:10:00.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82312024-08-27T19:10:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82322024-08-27T19:10:00.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82332024-08-27T19:10:00.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82342024-08-27T19:10:00.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82352024-08-27T19:10:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82362024-08-27T19:10:00.624ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 397.469792ms iteration = 16 status = {}
82372024-08-27T19:10:00.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1123 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = cef27678-666d-4b1e-b29d-dce7e47342f7 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
82382024-08-27T19:10:01.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f1b47f7-b564-4f9d-b6ea-aa2b011b69ec roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82392024-08-27T19:10:01.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f1b47f7-b564-4f9d-b6ea-aa2b011b69ec resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82402024-08-27T19:10:01.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9f1b47f7-b564-4f9d-b6ea-aa2b011b69ec response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82412024-08-27T19:10:02.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28b6a3e8-13dc-4484-953e-98875dca3ba2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82422024-08-27T19:10:02.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28b6a3e8-13dc-4484-953e-98875dca3ba2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82432024-08-27T19:10:02.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 28b6a3e8-13dc-4484-953e-98875dca3ba2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82442024-08-27T19:10:03.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5efe0603-9b15-4c44-a496-8b5351eaad82 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82452024-08-27T19:10:03.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5efe0603-9b15-4c44-a496-8b5351eaad82 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82462024-08-27T19:10:03.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5efe0603-9b15-4c44-a496-8b5351eaad82 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82472024-08-27T19:10:04.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a33949e4-7c54-480f-bdd1-63d8953980d7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82482024-08-27T19:10:04.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a33949e4-7c54-480f-bdd1-63d8953980d7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82492024-08-27T19:10:04.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a33949e4-7c54-480f-bdd1-63d8953980d7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82502024-08-27T19:10:05.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 864e6fdb-bd8c-48a0-a58f-f72e645399d2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82512024-08-27T19:10:05.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 864e6fdb-bd8c-48a0-a58f-f72e645399d2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82522024-08-27T19:10:05.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 864e6fdb-bd8c-48a0-a58f-f72e645399d2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82532024-08-27T19:10:06.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 11ce3879-4b54-4c30-8658-2f9fb648bc21 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82542024-08-27T19:10:06.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 11ce3879-4b54-4c30-8658-2f9fb648bc21 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82552024-08-27T19:10:06.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 11ce3879-4b54-4c30-8658-2f9fb648bc21 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82562024-08-27T19:10:07.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5147bb2-2d2d-4ad8-9050-486692647992 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82572024-08-27T19:10:07.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5147bb2-2d2d-4ad8-9050-486692647992 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82582024-08-27T19:10:07.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c5147bb2-2d2d-4ad8-9050-486692647992 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82592024-08-27T19:10:08.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5631e4fe-f63f-4e18-8b12-3903d2fb1b81 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82602024-08-27T19:10:08.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5631e4fe-f63f-4e18-8b12-3903d2fb1b81 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82612024-08-27T19:10:08.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5631e4fe-f63f-4e18-8b12-3903d2fb1b81 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82622024-08-27T19:10:09.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e73724d-0b4a-4598-86aa-8b2636393fa9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82632024-08-27T19:10:09.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e73724d-0b4a-4598-86aa-8b2636393fa9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82642024-08-27T19:10:09.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 3e73724d-0b4a-4598-86aa-8b2636393fa9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82652024-08-27T19:10:10.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
82662024-08-27T19:10:10.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
82672024-08-27T19:10:10.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82682024-08-27T19:10:10.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82692024-08-27T19:10:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82702024-08-27T19:10:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82712024-08-27T19:10:10.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82722024-08-27T19:10:10.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82732024-08-27T19:10:10.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82742024-08-27T19:10:10.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.817428ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82752024-08-27T19:10:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82762024-08-27T19:10:10.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82772024-08-27T19:10:10.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82782024-08-27T19:10:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82792024-08-27T19:10:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82802024-08-27T19:10:10.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82812024-08-27T19:10:10.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
82822024-08-27T19:10:10.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82832024-08-27T19:10:10.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82842024-08-27T19:10:10.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
82852024-08-27T19:10:10.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.963996ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
82862024-08-27T19:10:10.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74ef23f8-70eb-4a56-ad00-f090d9b5db75 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82872024-08-27T19:10:10.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74ef23f8-70eb-4a56-ad00-f090d9b5db75 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82882024-08-27T19:10:10.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 74ef23f8-70eb-4a56-ad00-f090d9b5db75 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82892024-08-27T19:10:10.985ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 692 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 593eef85-2862-47f6-aaea-6e8876a560e8 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
82902024-08-27T19:10:11.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a6383e-91de-45a9-b40d-b8d892ab3457 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82912024-08-27T19:10:11.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a6383e-91de-45a9-b40d-b8d892ab3457 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82922024-08-27T19:10:11.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 50a6383e-91de-45a9-b40d-b8d892ab3457 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82932024-08-27T19:10:12.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 79fd5eab-2c20-4f3d-82c4-398ea4acf905 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82942024-08-27T19:10:12.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 79fd5eab-2c20-4f3d-82c4-398ea4acf905 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82952024-08-27T19:10:12.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 79fd5eab-2c20-4f3d-82c4-398ea4acf905 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82962024-08-27T19:10:13.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 37ec6fcb-d957-4f94-8940-f68f32f2e8f6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82972024-08-27T19:10:13.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 37ec6fcb-d957-4f94-8940-f68f32f2e8f6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82982024-08-27T19:10:13.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 37ec6fcb-d957-4f94-8940-f68f32f2e8f6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
82992024-08-27T19:10:14.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8836d89c-db34-476d-9022-e20562e84ae5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83002024-08-27T19:10:14.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8836d89c-db34-476d-9022-e20562e84ae5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83012024-08-27T19:10:14.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8836d89c-db34-476d-9022-e20562e84ae5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83022024-08-27T19:10:16.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a1360bb-7773-4c0c-aee2-4240f4b427ab roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83032024-08-27T19:10:16.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a1360bb-7773-4c0c-aee2-4240f4b427ab resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83042024-08-27T19:10:16.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4a1360bb-7773-4c0c-aee2-4240f4b427ab response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83052024-08-27T19:10:17.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02837e45-b052-4fb0-a872-872ac2557cb7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83062024-08-27T19:10:17.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02837e45-b052-4fb0-a872-872ac2557cb7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83072024-08-27T19:10:17.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 02837e45-b052-4fb0-a872-872ac2557cb7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83082024-08-27T19:10:18.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27f7e49d-64a1-4c4e-a28c-45d488dc9c96 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83092024-08-27T19:10:18.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27f7e49d-64a1-4c4e-a28c-45d488dc9c96 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83102024-08-27T19:10:18.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 27f7e49d-64a1-4c4e-a28c-45d488dc9c96 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83112024-08-27T19:10:18.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 67f743cf-84c3-4a6d-9b1e-d967bad80ba7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
83122024-08-27T19:10:18.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 67f743cf-84c3-4a6d-9b1e-d967bad80ba7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
83132024-08-27T19:10:18.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 67f743cf-84c3-4a6d-9b1e-d967bad80ba7 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
83142024-08-27T19:10:19.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d7f30f3d-941e-4210-a470-1d1ca3515112 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83152024-08-27T19:10:19.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d7f30f3d-941e-4210-a470-1d1ca3515112 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83162024-08-27T19:10:19.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d7f30f3d-941e-4210-a470-1d1ca3515112 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83172024-08-27T19:10:20.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 16cdff3f-032b-4aec-802b-b892ce1c1a15 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83182024-08-27T19:10:20.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 16cdff3f-032b-4aec-802b-b892ce1c1a15 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83192024-08-27T19:10:20.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 16cdff3f-032b-4aec-802b-b892ce1c1a15 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83202024-08-27T19:10:20.229ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
83212024-08-27T19:10:20.229ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
83222024-08-27T19:10:20.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83232024-08-27T19:10:20.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83242024-08-27T19:10:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83252024-08-27T19:10:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83262024-08-27T19:10:20.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83272024-08-27T19:10:20.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83282024-08-27T19:10:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83292024-08-27T19:10:20.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.315907ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83302024-08-27T19:10:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83312024-08-27T19:10:20.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83322024-08-27T19:10:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83332024-08-27T19:10:20.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83342024-08-27T19:10:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83352024-08-27T19:10:20.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83362024-08-27T19:10:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
83372024-08-27T19:10:20.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83382024-08-27T19:10:20.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83392024-08-27T19:10:20.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
83402024-08-27T19:10:20.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.286412ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
83412024-08-27T19:10:20.985ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 578 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 3a4a66f0-9d84-4675-9418-8550b153e383 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
83422024-08-27T19:10:21.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c8b1fc05-38c2-4f6f-adf1-036dfa144326 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83432024-08-27T19:10:21.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c8b1fc05-38c2-4f6f-adf1-036dfa144326 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83442024-08-27T19:10:21.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c8b1fc05-38c2-4f6f-adf1-036dfa144326 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83452024-08-27T19:10:22.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5bb3dac5-47e7-4674-b82e-7758a9dce946 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83462024-08-27T19:10:22.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5bb3dac5-47e7-4674-b82e-7758a9dce946 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83472024-08-27T19:10:22.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5bb3dac5-47e7-4674-b82e-7758a9dce946 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83482024-08-27T19:10:23.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ec35b11-2c9b-4ab4-9e83-193bf6c2726e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83492024-08-27T19:10:23.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ec35b11-2c9b-4ab4-9e83-193bf6c2726e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83502024-08-27T19:10:23.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9ec35b11-2c9b-4ab4-9e83-193bf6c2726e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83512024-08-27T19:10:24.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b0ff63e-5890-466c-92dc-c8a5f6be86cb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83522024-08-27T19:10:24.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b0ff63e-5890-466c-92dc-c8a5f6be86cb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83532024-08-27T19:10:24.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4b0ff63e-5890-466c-92dc-c8a5f6be86cb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83542024-08-27T19:10:25.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f991db29-d6bf-4eef-9d05-2cf9f670ff79 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83552024-08-27T19:10:25.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f991db29-d6bf-4eef-9d05-2cf9f670ff79 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83562024-08-27T19:10:25.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f991db29-d6bf-4eef-9d05-2cf9f670ff79 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83572024-08-27T19:10:26.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7918785-2276-458b-abfd-beda39ecda3b roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83582024-08-27T19:10:26.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7918785-2276-458b-abfd-beda39ecda3b resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83592024-08-27T19:10:26.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a7918785-2276-458b-abfd-beda39ecda3b response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83602024-08-27T19:10:27.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4edf9c1-cba3-4ee0-8874-7d5908737916 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83612024-08-27T19:10:27.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4edf9c1-cba3-4ee0-8874-7d5908737916 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83622024-08-27T19:10:27.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c4edf9c1-cba3-4ee0-8874-7d5908737916 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83632024-08-27T19:10:28.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bb8386-74eb-4e65-a7a9-9d0c879b9cd9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83642024-08-27T19:10:28.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bb8386-74eb-4e65-a7a9-9d0c879b9cd9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83652024-08-27T19:10:28.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 46bb8386-74eb-4e65-a7a9-9d0c879b9cd9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83662024-08-27T19:10:29.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f1c41c9-7100-4a74-ad68-bb73bd5f56ab roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83672024-08-27T19:10:29.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f1c41c9-7100-4a74-ad68-bb73bd5f56ab resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83682024-08-27T19:10:29.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4f1c41c9-7100-4a74-ad68-bb73bd5f56ab response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
83692024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
83702024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
83712024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83722024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
83732024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83742024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
83752024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83762024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
83772024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
83782024-08-27T19:10:30.233ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
83792024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
83802024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.36\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
83812024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83822024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
83832024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83842024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83852024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
83862024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83872024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
83882024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
83892024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
83902024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83912024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
83922024-08-27T19:10:30.233ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 19:00:30.233386705 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83932024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
83942024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
83952024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
83962024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
83972024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83982024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
83992024-08-27T19:10:30.233ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84002024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84012024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
84022024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84032024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
84042024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84052024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84062024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
84072024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84082024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
84092024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84102024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
84112024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84122024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84132024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84142024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84152024-08-27T19:10:30.233ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 883964625 } })
84162024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84172024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84182024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
84192024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
84202024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84212024-08-27T19:10:30.233ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
84222024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
84232024-08-27T19:10:30.233ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
84242024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
84252024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84262024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84272024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84282024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
84292024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84302024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
84312024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84322024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
84332024-08-27T19:10:30.233ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 884113868 } })
84342024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84352024-08-27T19:10:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84362024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84372024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84382024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84392024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84402024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84412024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84422024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84432024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84442024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84452024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84462024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84472024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84482024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84492024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84502024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84512024-08-27T19:10:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84522024-08-27T19:10:30.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532024-08-27T19:10:30.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84542024-08-27T19:10:30.235ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84552024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.787127ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84562024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84572024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84582024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84592024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84602024-08-27T19:10:30.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84612024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
84622024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.676155ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
84632024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84642024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
84652024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.886429ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
84662024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672024-08-27T19:10:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84682024-08-27T19:10:30.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 888349505 } })
84692024-08-27T19:10:30.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 888433666 } })
84702024-08-27T19:10:30.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.867479ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84712024-08-27T19:10:30.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84722024-08-27T19:10:30.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84732024-08-27T19:10:30.239ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 19:00:30.233386705 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
84742024-08-27T19:10:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.770948ms iteration = 9 status = {"expiration":"2024-08-27T19:00:30.233386705Z","pruned":[]}
84752024-08-27T19:10:30.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
84762024-08-27T19:10:30.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
84772024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84782024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84792024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.642586ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
84802024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84812024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84822024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84832024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84842024-08-27T19:10:30.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84852024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84862024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84872024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84882024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84892024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84902024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84912024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84922024-08-27T19:10:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84932024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84942024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84952024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84962024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84972024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84982024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84992024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85002024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.839041ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
85012024-08-27T19:10:30.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85022024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85032024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85042024-08-27T19:10:30.243ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
85052024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.495544ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85062024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85072024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85082024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85092024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85102024-08-27T19:10:30.243ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
85112024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 10.027414ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85122024-08-27T19:10:30.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85132024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85142024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85152024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85162024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
85172024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85182024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85192024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85202024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85212024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85222024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85232024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85242024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85252024-08-27T19:10:30.244ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
85262024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85272024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85282024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85292024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85302024-08-27T19:10:30.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85312024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85322024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85332024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85352024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
85362024-08-27T19:10:30.245ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
85372024-08-27T19:10:30.245ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.103547ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
85382024-08-27T19:10:30.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85392024-08-27T19:10:30.246ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85402024-08-27T19:10:30.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85412024-08-27T19:10:30.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85422024-08-27T19:10:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85432024-08-27T19:10:30.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85442024-08-27T19:10:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85452024-08-27T19:10:30.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85462024-08-27T19:10:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85472024-08-27T19:10:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
85482024-08-27T19:10:30.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85492024-08-27T19:10:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85502024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85512024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85522024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85532024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85542024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85552024-08-27T19:10:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85562024-08-27T19:10:30.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85572024-08-27T19:10:30.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85582024-08-27T19:10:30.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85592024-08-27T19:10:30.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85602024-08-27T19:10:30.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85612024-08-27T19:10:30.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.504969ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85622024-08-27T19:10:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85632024-08-27T19:10:30.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.463749ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
85642024-08-27T19:10:30.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652024-08-27T19:10:30.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85662024-08-27T19:10:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85672024-08-27T19:10:30.258ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85682024-08-27T19:10:30.258ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
85692024-08-27T19:10:30.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85702024-08-27T19:10:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85712024-08-27T19:10:30.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85722024-08-27T19:10:30.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85732024-08-27T19:10:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85742024-08-27T19:10:30.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752024-08-27T19:10:30.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85762024-08-27T19:10:30.263ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85772024-08-27T19:10:30.263ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85782024-08-27T19:10:30.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85792024-08-27T19:10:30.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85802024-08-27T19:10:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85812024-08-27T19:10:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85822024-08-27T19:10:30.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85832024-08-27T19:10:30.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85842024-08-27T19:10:30.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85852024-08-27T19:10:30.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85862024-08-27T19:10:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85872024-08-27T19:10:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.8167ms iteration = 19 status = {"physical_disks_added":0}
85882024-08-27T19:10:30.267ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85892024-08-27T19:10:30.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.703358ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85902024-08-27T19:10:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85912024-08-27T19:10:30.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85922024-08-27T19:10:30.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85932024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85942024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85952024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
85962024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85972024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85982024-08-27T19:10:30.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85992024-08-27T19:10:30.269ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
86002024-08-27T19:10:30.269ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86012024-08-27T19:10:30.269ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
86022024-08-27T19:10:30.269ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 35.719699ms iteration = 9 status = {"generation":2}
86032024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86042024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
86052024-08-27T19:10:30.270ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 920616993 } })
86062024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86072024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
86082024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 36.950274ms iteration = 9 status = {"generation":1}
86092024-08-27T19:10:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86102024-08-27T19:10:30.270ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
86112024-08-27T19:10:30.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86122024-08-27T19:10:30.272ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
86132024-08-27T19:10:30.272ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 39.621009ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86142024-08-27T19:10:30.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86152024-08-27T19:10:30.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86162024-08-27T19:10:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86172024-08-27T19:10:30.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86182024-08-27T19:10:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86192024-08-27T19:10:30.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86202024-08-27T19:10:30.275ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
86212024-08-27T19:10:30.275ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.917976ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
86222024-08-27T19:10:30.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86232024-08-27T19:10:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86242024-08-27T19:10:30.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86252024-08-27T19:10:30.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86262024-08-27T19:10:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86272024-08-27T19:10:30.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86282024-08-27T19:10:30.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
86292024-08-27T19:10:30.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86302024-08-27T19:10:30.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86312024-08-27T19:10:30.280ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.409857ms iteration = 17 status = 0
86322024-08-27T19:10:30.285ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
86332024-08-27T19:10:30.285ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86342024-08-27T19:10:30.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.42273ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
86352024-08-27T19:10:30.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6f1bfec-aabd-47eb-aafa-bf6f78b94c82 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
86362024-08-27T19:10:30.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6f1bfec-aabd-47eb-aafa-bf6f78b94c82 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
86372024-08-27T19:10:30.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d6f1bfec-aabd-47eb-aafa-bf6f78b94c82 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
86382024-08-27T19:10:30.435ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86392024-08-27T19:10:30.471ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86402024-08-27T19:10:30.471ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ec0193f-c6de-4058-a8ed-0424639cf615", "content-length": "691", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86412024-08-27T19:10:30.471ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86422024-08-27T19:10:30.471ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86432024-08-27T19:10:30.471ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86442024-08-27T19:10:30.472ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 239.689931ms iteration = 18 status = {}
86452024-08-27T19:10:30.473ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86462024-08-27T19:10:30.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
86472024-08-27T19:10:30.498ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86482024-08-27T19:10:30.499ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86492024-08-27T19:10:30.499ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1be99802-01c0-402f-b33d-8d12587e626c", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86502024-08-27T19:10:30.499ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86512024-08-27T19:10:30.499ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e5af0217-90e9-4b65-8181-47e9f8feba7e", "content-length": "372", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86522024-08-27T19:10:30.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86532024-08-27T19:10:30.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86542024-08-27T19:10:30.501ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86552024-08-27T19:10:30.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86562024-08-27T19:10:30.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86572024-08-27T19:10:30.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86582024-08-27T19:10:30.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86592024-08-27T19:10:30.507ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86602024-08-27T19:10:30.508ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7f07da5e-7476-4c84-b98c-0f0cfec1eb2e", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86612024-08-27T19:10:30.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 275.477952ms iteration = 18 status = {}
86622024-08-27T19:10:30.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
86632024-08-27T19:10:30.531ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86642024-08-27T19:10:30.531ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fdb778ec-1ffe-49be-8218-796d4960125c", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86652024-08-27T19:10:30.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86662024-08-27T19:10:30.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86672024-08-27T19:10:30.582ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
86682024-08-27T19:10:30.582ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86692024-08-27T19:10:30.582ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10ca5539-b1fa-493a-a966-5858445a8e5e", "content-length": "26", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86702024-08-27T19:10:30.582ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86712024-08-27T19:10:30.584ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
86722024-08-27T19:10:30.606ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
86732024-08-27T19:10:30.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7acd4bf6-3233-4066-86fd-2778fc3e464b", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86742024-08-27T19:10:30.606ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86752024-08-27T19:10:30.607ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "90c27157-c1b0-47b8-b630-85ac79251061", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86762024-08-27T19:10:30.607ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86772024-08-27T19:10:30.609ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86782024-08-27T19:10:30.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 376.121346ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86792024-08-27T19:10:30.621ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86802024-08-27T19:10:30.743ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 510.314174ms iteration = 17 status = {}
86812024-08-27T19:10:30.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
86822024-08-27T19:10:30.749ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "65f1118d-ac6d-43c2-bbb3-48280bcc2be9", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86832024-08-27T19:10:30.749ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86842024-08-27T19:10:30.752ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8783e7c3-207e-4bc7-ad64-acfd8bf5e9c4", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86852024-08-27T19:10:30.752ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86862024-08-27T19:10:30.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fa576f13-09bd-4b7d-ad7b-989ce16bc217", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86872024-08-27T19:10:30.754ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86882024-08-27T19:10:30.756ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
86892024-08-27T19:10:30.756ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 523.254608ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86902024-08-27T19:10:30.760ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86912024-08-27T19:10:30.760ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03e2c48e-e28e-45be-9226-9ffb490c6387", "content-length": "2", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
86922024-08-27T19:10:30.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86932024-08-27T19:10:30.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86942024-08-27T19:10:30.764ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 530.977426ms iteration = 17 status = null
86952024-08-27T19:10:30.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86962024-08-27T19:10:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86972024-08-27T19:10:30.809ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
86982024-08-27T19:10:30.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86992024-08-27T19:10:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87002024-08-27T19:10:30.818ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87012024-08-27T19:10:30.818ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4613c68d-76b5-4e5a-8843-020c1f0242ea", "content-length": "121", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
87022024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
87032024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
87042024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87052024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87062024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
87072024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
87082024-08-27T19:10:30.818ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
87092024-08-27T19:10:30.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87102024-08-27T19:10:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87112024-08-27T19:10:30.820ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87122024-08-27T19:10:30.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45099950-7146-49b7-8843-684957300619", "content-length": "2", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
87132024-08-27T19:10:30.820ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87142024-08-27T19:10:30.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5260c3b6-1a9b-4c9a-add6-36640f131c95", "content-length": "52", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
87152024-08-27T19:10:30.820ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
87162024-08-27T19:10:30.820ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87172024-08-27T19:10:30.959ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5477bb3e-cb93-4d12-9125-d22f1893a0ee", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
87182024-08-27T19:10:30.959ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
87192024-08-27T19:10:30.959ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87202024-08-27T19:10:30.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6650045c-7581-4acb-aaa7-83d63f8313ef", "content-length": "667", "date": "Tue, 27 Aug 2024 19:10:30 GMT"} })
87212024-08-27T19:10:30.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87222024-08-27T19:10:30.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87232024-08-27T19:10:30.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87242024-08-27T19:10:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87252024-08-27T19:10:30.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87262024-08-27T19:10:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87272024-08-27T19:10:30.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87282024-08-27T19:10:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87292024-08-27T19:10:30.974ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.480663ms iteration = 17 status = {}
87302024-08-27T19:10:30.989ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1160 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = f2253923-df9a-4b51-abe0-e129b0bc6469 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
87312024-08-27T19:10:31.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 36f98fd8-1a2b-4b01-8663-1eff38f685a3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87322024-08-27T19:10:31.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 36f98fd8-1a2b-4b01-8663-1eff38f685a3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87332024-08-27T19:10:31.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 36f98fd8-1a2b-4b01-8663-1eff38f685a3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87342024-08-27T19:10:32.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c003b41a-1bcd-4111-8b52-fee5ad88f1af roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87352024-08-27T19:10:32.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c003b41a-1bcd-4111-8b52-fee5ad88f1af resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87362024-08-27T19:10:32.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c003b41a-1bcd-4111-8b52-fee5ad88f1af response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87372024-08-27T19:10:33.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cd32719-55b0-4df5-a97a-3b8108f077ea roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87382024-08-27T19:10:33.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cd32719-55b0-4df5-a97a-3b8108f077ea resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87392024-08-27T19:10:33.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8cd32719-55b0-4df5-a97a-3b8108f077ea response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87402024-08-27T19:10:34.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9dcb448c-432e-49d8-b845-32d15c1ef802 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87412024-08-27T19:10:34.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9dcb448c-432e-49d8-b845-32d15c1ef802 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87422024-08-27T19:10:34.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 9dcb448c-432e-49d8-b845-32d15c1ef802 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87432024-08-27T19:10:35.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8674dda8-dfab-4093-ab5e-fcba6a09f7d0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87442024-08-27T19:10:35.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8674dda8-dfab-4093-ab5e-fcba6a09f7d0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87452024-08-27T19:10:35.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8674dda8-dfab-4093-ab5e-fcba6a09f7d0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87462024-08-27T19:10:36.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7bec9f09-8a03-444d-8237-e28b5c441359 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87472024-08-27T19:10:36.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7bec9f09-8a03-444d-8237-e28b5c441359 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87482024-08-27T19:10:36.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7bec9f09-8a03-444d-8237-e28b5c441359 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87492024-08-27T19:10:37.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa252f5-0697-417e-8c63-05b39df3fbbd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87502024-08-27T19:10:37.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa252f5-0697-417e-8c63-05b39df3fbbd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87512024-08-27T19:10:37.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 8fa252f5-0697-417e-8c63-05b39df3fbbd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87522024-08-27T19:10:38.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a07e93a7-2043-4422-adbb-48c81851193d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87532024-08-27T19:10:38.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a07e93a7-2043-4422-adbb-48c81851193d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87542024-08-27T19:10:38.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a07e93a7-2043-4422-adbb-48c81851193d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87552024-08-27T19:10:39.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51e54e71-21aa-4724-ab63-5dbb841372c2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87562024-08-27T19:10:39.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51e54e71-21aa-4724-ab63-5dbb841372c2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87572024-08-27T19:10:39.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 51e54e71-21aa-4724-ab63-5dbb841372c2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87582024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
87592024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
87602024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87612024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87622024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87632024-08-27T19:10:40.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87642024-08-27T19:10:40.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87652024-08-27T19:10:40.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87662024-08-27T19:10:40.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87672024-08-27T19:10:40.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.780377ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87682024-08-27T19:10:40.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87692024-08-27T19:10:40.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87702024-08-27T19:10:40.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87712024-08-27T19:10:40.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87722024-08-27T19:10:40.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87732024-08-27T19:10:40.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87742024-08-27T19:10:40.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
87752024-08-27T19:10:40.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87762024-08-27T19:10:40.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87772024-08-27T19:10:40.248ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
87782024-08-27T19:10:40.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.480776ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
87792024-08-27T19:10:40.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c171b049-f78a-4569-9eb9-cd04f7f5fd34 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87802024-08-27T19:10:40.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c171b049-f78a-4569-9eb9-cd04f7f5fd34 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87812024-08-27T19:10:40.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c171b049-f78a-4569-9eb9-cd04f7f5fd34 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87822024-08-27T19:10:40.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 798 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = dd7c5edf-04c4-4beb-99e3-b35ff06f32b7 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
87832024-08-27T19:10:41.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce3afde-048d-49b6-9836-61e1e93e816e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87842024-08-27T19:10:41.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce3afde-048d-49b6-9836-61e1e93e816e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87852024-08-27T19:10:41.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fce3afde-048d-49b6-9836-61e1e93e816e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87862024-08-27T19:10:42.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f303813d-2ffa-4f80-80c9-f96c853575c5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87872024-08-27T19:10:42.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f303813d-2ffa-4f80-80c9-f96c853575c5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87882024-08-27T19:10:42.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f303813d-2ffa-4f80-80c9-f96c853575c5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87892024-08-27T19:10:43.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = efab841f-a077-4799-94ed-d114c0f97fef roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87902024-08-27T19:10:43.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = efab841f-a077-4799-94ed-d114c0f97fef resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87912024-08-27T19:10:43.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = efab841f-a077-4799-94ed-d114c0f97fef response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87922024-08-27T19:10:44.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc68bdfc-5616-47a4-a085-73b5d71c08e1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87932024-08-27T19:10:44.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc68bdfc-5616-47a4-a085-73b5d71c08e1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87942024-08-27T19:10:44.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fc68bdfc-5616-47a4-a085-73b5d71c08e1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87952024-08-27T19:10:45.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8269394-add9-4e83-8cdc-efe61ff2188a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87962024-08-27T19:10:45.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8269394-add9-4e83-8cdc-efe61ff2188a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87972024-08-27T19:10:45.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f8269394-add9-4e83-8cdc-efe61ff2188a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87982024-08-27T19:10:46.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed6dfd54-91f1-40f1-92dd-66bf61445a0a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
87992024-08-27T19:10:46.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed6dfd54-91f1-40f1-92dd-66bf61445a0a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88002024-08-27T19:10:46.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ed6dfd54-91f1-40f1-92dd-66bf61445a0a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88012024-08-27T19:10:47.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3486710-abd3-4e8b-b35e-9d6936ac0ce4 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88022024-08-27T19:10:47.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3486710-abd3-4e8b-b35e-9d6936ac0ce4 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88032024-08-27T19:10:47.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = a3486710-abd3-4e8b-b35e-9d6936ac0ce4 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88042024-08-27T19:10:48.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5544705a-f9c0-4f3b-9d28-ff958165b3c2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
88052024-08-27T19:10:48.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5544705a-f9c0-4f3b-9d28-ff958165b3c2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
88062024-08-27T19:10:48.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = 5544705a-f9c0-4f3b-9d28-ff958165b3c2 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
88072024-08-27T19:10:48.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5fb0feb5-98d0-4045-ac23-224a8387321f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88082024-08-27T19:10:48.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5fb0feb5-98d0-4045-ac23-224a8387321f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88092024-08-27T19:10:48.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5fb0feb5-98d0-4045-ac23-224a8387321f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88102024-08-27T19:10:49.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 81c6ef23-9a7a-40a4-b274-5035437af940 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88112024-08-27T19:10:49.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 81c6ef23-9a7a-40a4-b274-5035437af940 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88122024-08-27T19:10:49.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 81c6ef23-9a7a-40a4-b274-5035437af940 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88132024-08-27T19:10:50.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
88142024-08-27T19:10:50.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88152024-08-27T19:10:50.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
88162024-08-27T19:10:50.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88172024-08-27T19:10:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88182024-08-27T19:10:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88192024-08-27T19:10:50.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88202024-08-27T19:10:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88212024-08-27T19:10:50.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88222024-08-27T19:10:50.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.279476ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88232024-08-27T19:10:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88242024-08-27T19:10:50.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88252024-08-27T19:10:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88262024-08-27T19:10:50.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88272024-08-27T19:10:50.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88282024-08-27T19:10:50.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292024-08-27T19:10:50.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
88302024-08-27T19:10:50.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88312024-08-27T19:10:50.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88322024-08-27T19:10:50.248ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
88332024-08-27T19:10:50.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.821063ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
88342024-08-27T19:10:50.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 995f724d-c685-45e6-98fa-118c3011e893 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88352024-08-27T19:10:50.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 995f724d-c685-45e6-98fa-118c3011e893 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88362024-08-27T19:10:50.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 995f724d-c685-45e6-98fa-118c3011e893 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88372024-08-27T19:10:50.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 890 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = d006315a-99ed-4621-99fd-556d48cfdcff response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
88382024-08-27T19:10:51.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcebe263-f388-45d8-89ea-d0a02b805618 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88392024-08-27T19:10:51.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcebe263-f388-45d8-89ea-d0a02b805618 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88402024-08-27T19:10:51.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fcebe263-f388-45d8-89ea-d0a02b805618 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88412024-08-27T19:10:52.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0748b682-c7b7-4f29-b74c-a58ba104b3c5 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88422024-08-27T19:10:52.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0748b682-c7b7-4f29-b74c-a58ba104b3c5 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88432024-08-27T19:10:52.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 0748b682-c7b7-4f29-b74c-a58ba104b3c5 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88442024-08-27T19:10:53.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbc6c3e1-d138-49fd-856c-6a1d475043d1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88452024-08-27T19:10:53.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbc6c3e1-d138-49fd-856c-6a1d475043d1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88462024-08-27T19:10:53.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbc6c3e1-d138-49fd-856c-6a1d475043d1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88472024-08-27T19:10:54.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76ac8a4f-55a5-4ba5-9775-83edc6fea5b6 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88482024-08-27T19:10:54.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76ac8a4f-55a5-4ba5-9775-83edc6fea5b6 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88492024-08-27T19:10:54.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 76ac8a4f-55a5-4ba5-9775-83edc6fea5b6 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88502024-08-27T19:10:55.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1c7bcce5-79c3-45e4-bbd2-3781ee0819bd roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88512024-08-27T19:10:55.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1c7bcce5-79c3-45e4-bbd2-3781ee0819bd resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88522024-08-27T19:10:55.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1c7bcce5-79c3-45e4-bbd2-3781ee0819bd response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88532024-08-27T19:10:56.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e3d07e4-024e-4b75-97fc-9f5a92576402 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88542024-08-27T19:10:56.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e3d07e4-024e-4b75-97fc-9f5a92576402 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88552024-08-27T19:10:56.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5e3d07e4-024e-4b75-97fc-9f5a92576402 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88562024-08-27T19:10:57.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 45a48a37-b320-4375-8b1f-25a8694167f0 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88572024-08-27T19:10:57.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 45a48a37-b320-4375-8b1f-25a8694167f0 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88582024-08-27T19:10:57.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 45a48a37-b320-4375-8b1f-25a8694167f0 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88592024-08-27T19:10:58.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5b26306-d1d4-4373-85a9-a293d87a1b5c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88602024-08-27T19:10:58.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5b26306-d1d4-4373-85a9-a293d87a1b5c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88612024-08-27T19:10:58.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5b26306-d1d4-4373-85a9-a293d87a1b5c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88622024-08-27T19:10:59.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ea4e8445-6900-4c87-96ab-c2ec308933d1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88632024-08-27T19:10:59.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ea4e8445-6900-4c87-96ab-c2ec308933d1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88642024-08-27T19:10:59.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ea4e8445-6900-4c87-96ab-c2ec308933d1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
88652024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
88662024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
88672024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88682024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88692024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88702024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
88712024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
88722024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88732024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
88742024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88752024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88762024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
88772024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
88782024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88792024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88802024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
88812024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88822024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
88832024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
88842024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88852024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88862024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
88872024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
88882024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88892024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88902024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
88912024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
88922024-08-27T19:11:00.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88932024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
88942024-08-27T19:11:00.232ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
88952024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88962024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88972024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
88982024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88992024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89002024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89012024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89022024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89032024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89042024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89052024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89062024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89072024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89082024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89092024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89102024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89112024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89122024-08-27T19:11:00.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89132024-08-27T19:11:00.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142024-08-27T19:11:00.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89152024-08-27T19:11:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89162024-08-27T19:11:00.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 885834045 } })
89172024-08-27T19:11:00.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182024-08-27T19:11:00.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89192024-08-27T19:11:00.234ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.551342ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89202024-08-27T19:11:00.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212024-08-27T19:11:00.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89222024-08-27T19:11:00.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
89232024-08-27T19:11:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.491321ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
89242024-08-27T19:11:00.235ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
89252024-08-27T19:11:00.235ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89262024-08-27T19:11:00.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89272024-08-27T19:11:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.117424ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89282024-08-27T19:11:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89292024-08-27T19:11:00.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 888494120 } })
89302024-08-27T19:11:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89312024-08-27T19:11:00.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89322024-08-27T19:11:00.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89332024-08-27T19:11:00.237ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
89342024-08-27T19:11:00.237ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89352024-08-27T19:11:00.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.288728ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
89362024-08-27T19:11:00.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
89372024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89382024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89392024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89402024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89412024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89422024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89432024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89442024-08-27T19:11:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89452024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89462024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89472024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89482024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89492024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89502024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89512024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89522024-08-27T19:11:00.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89532024-08-27T19:11:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89542024-08-27T19:11:00.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89552024-08-27T19:11:00.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 892288127 } })
89562024-08-27T19:11:00.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
89572024-08-27T19:11:00.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-08-27T19:11:00.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.121597ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
89592024-08-27T19:11:00.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89602024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89612024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89622024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89632024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89642024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89652024-08-27T19:11:00.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89662024-08-27T19:11:00.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89672024-08-27T19:11:00.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89682024-08-27T19:11:00.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.26968ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89702024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89712024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89722024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89732024-08-27T19:11:00.243ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
89742024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.481624ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89752024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89762024-08-27T19:11:00.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89772024-08-27T19:11:00.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89782024-08-27T19:11:00.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89792024-08-27T19:11:00.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89802024-08-27T19:11:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
89812024-08-27T19:11:00.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89822024-08-27T19:11:00.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89832024-08-27T19:11:00.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89842024-08-27T19:11:00.246ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89852024-08-27T19:11:00.246ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.996386ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89862024-08-27T19:11:00.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89872024-08-27T19:11:00.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89882024-08-27T19:11:00.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89892024-08-27T19:11:00.251ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.647811ms iteration = 20 status = {"physical_disks_added":0}
89902024-08-27T19:11:00.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89912024-08-27T19:11:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89922024-08-27T19:11:00.252ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
89932024-08-27T19:11:00.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.636711ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
89942024-08-27T19:11:00.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89952024-08-27T19:11:00.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89962024-08-27T19:11:00.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89972024-08-27T19:11:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89982024-08-27T19:11:00.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992024-08-27T19:11:00.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90002024-08-27T19:11:00.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90012024-08-27T19:11:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90022024-08-27T19:11:00.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90032024-08-27T19:11:00.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90042024-08-27T19:11:00.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90052024-08-27T19:11:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90062024-08-27T19:11:00.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072024-08-27T19:11:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
90082024-08-27T19:11:00.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90092024-08-27T19:11:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90102024-08-27T19:11:00.265ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 34.032635ms iteration = 18 status = 0
90112024-08-27T19:11:00.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
90122024-08-27T19:11:00.334ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90132024-08-27T19:11:00.334ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1638536-5bf5-4e72-890a-de3ad055ef10", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90142024-08-27T19:11:00.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90152024-08-27T19:11:00.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90162024-08-27T19:11:00.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
90172024-08-27T19:11:00.337ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90182024-08-27T19:11:00.337ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c65be18-ad2f-4c20-8597-1810a7890bc5", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90192024-08-27T19:11:00.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90202024-08-27T19:11:00.339ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
90212024-08-27T19:11:00.339ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90222024-08-27T19:11:00.339ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
90232024-08-27T19:11:00.340ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7a7620b3-b7b6-49f8-8a0a-f81b363c8d69", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90242024-08-27T19:11:00.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90252024-08-27T19:11:00.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90262024-08-27T19:11:00.382ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90272024-08-27T19:11:00.382ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b12a357c-0cc1-4ca5-8cbf-d795e2991233", "content-length": "372", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90282024-08-27T19:11:00.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90292024-08-27T19:11:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90302024-08-27T19:11:00.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90312024-08-27T19:11:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90322024-08-27T19:11:00.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90332024-08-27T19:11:00.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90342024-08-27T19:11:00.387ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90352024-08-27T19:11:00.387ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3d42ef51-0eba-4326-a566-69b89f4bf605", "content-length": "691", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90362024-08-27T19:11:00.387ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90372024-08-27T19:11:00.387ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90382024-08-27T19:11:00.387ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90392024-08-27T19:11:00.388ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 157.070796ms iteration = 19 status = {}
90402024-08-27T19:11:00.389ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90412024-08-27T19:11:00.389ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef1b23d7-0169-4edd-ac4d-dc4cc0f821c9", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90422024-08-27T19:11:00.390ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.006095ms iteration = 19 status = {}
90432024-08-27T19:11:00.444ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90442024-08-27T19:11:00.444ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ace535c-77f9-49cd-ae1c-5126c9d326df", "content-length": "2", "date": "Tue, 27 Aug 2024 19:10:59 GMT"} })
90452024-08-27T19:11:00.446ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90462024-08-27T19:11:00.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90472024-08-27T19:11:00.448ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.682762ms iteration = 18 status = null
90482024-08-27T19:11:00.448ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.906846ms iteration = 18 status = {}
90492024-08-27T19:11:00.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90502024-08-27T19:11:00.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90512024-08-27T19:11:00.511ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
90522024-08-27T19:11:00.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90532024-08-27T19:11:00.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90542024-08-27T19:11:00.520ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90552024-08-27T19:11:00.520ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "372f810f-066a-40ab-bedb-6411e8ef821b", "content-length": "121", "date": "Tue, 27 Aug 2024 19:10:59 GMT"} })
90562024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
90572024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
90582024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90592024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90602024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
90612024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
90622024-08-27T19:11:00.520ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
90632024-08-27T19:11:00.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90642024-08-27T19:11:00.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90652024-08-27T19:11:00.522ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90662024-08-27T19:11:00.522ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94aff6cb-c11a-41cf-9d03-c1ea69d75ce7", "content-length": "2", "date": "Tue, 27 Aug 2024 19:10:59 GMT"} })
90672024-08-27T19:11:00.522ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90682024-08-27T19:11:00.522ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "484705d7-bef7-4187-9713-7b29cca195db", "content-length": "52", "date": "Tue, 27 Aug 2024 19:10:59 GMT"} })
90692024-08-27T19:11:00.522ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
90702024-08-27T19:11:00.522ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90712024-08-27T19:11:00.667ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6a150c95-c409-4d94-9023-3a02cba54802", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90722024-08-27T19:11:00.667ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
90732024-08-27T19:11:00.667ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90742024-08-27T19:11:00.667ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d503e2a8-04c0-451e-817c-737de3d5f005", "content-length": "667", "date": "Tue, 27 Aug 2024 19:11:00 GMT"} })
90752024-08-27T19:11:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90762024-08-27T19:11:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90772024-08-27T19:11:00.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90782024-08-27T19:11:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90792024-08-27T19:11:00.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90802024-08-27T19:11:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90812024-08-27T19:11:00.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90822024-08-27T19:11:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90832024-08-27T19:11:00.681ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 450.051865ms iteration = 18 status = {}
90842024-08-27T19:11:00.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b25b485-fa5e-401e-82bb-9d9e23f24ab3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
90852024-08-27T19:11:00.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b25b485-fa5e-401e-82bb-9d9e23f24ab3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
90862024-08-27T19:11:00.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6b25b485-fa5e-401e-82bb-9d9e23f24ab3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
90872024-08-27T19:11:00.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 623 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 0ef4f99a-7a9a-455b-9568-cfea045c464b response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
90882024-08-27T19:11:00.989ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
90892024-08-27T19:11:00.989ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
90902024-08-27T19:11:01.021ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
90912024-08-27T19:11:01.021ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62588
90922024-08-27T19:11:01.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 9b399d05-a0c2-4a9f-a8a6-9596571b1c71 roles = RoleSet { roles: {} } uri = /metrics/producers
90932024-08-27T19:11:01.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 9b399d05-a0c2-4a9f-a8a6-9596571b1c71 resource = Database result = Ok(()) uri = /metrics/producers
90942024-08-27T19:11:01.058ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 4acc4057-9e37-454f-b1dd-7cbe37073be1
90952024-08-27T19:11:01.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 9b399d05-a0c2-4a9f-a8a6-9596571b1c71 roles = RoleSet { roles: {} } uri = /metrics/producers
90962024-08-27T19:11:01.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 9b399d05-a0c2-4a9f-a8a6-9596571b1c71 resource = Database result = Ok(()) uri = /metrics/producers
90972024-08-27T19:11:01.089ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 uri = http://[fd00:1122:3344:101::d]:12223/producers
90982024-08-27T19:11:01.089ZDEBGnexus: client response oximeter-collector = 4acc4057-9e37-454f-b1dd-7cbe37073be1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6f720e03-4b83-4eb4-a233-db19dbdc1f00", "date": "Tue, 27 Aug 2024 19:11:01 GMT"} })
90992024-08-27T19:11:01.089ZINFOnexus: assigned collector to new producer collector_id = 4acc4057-9e37-454f-b1dd-7cbe37073be1 file = nexus/src/app/oximeter.rs:125 producer_id = 8f71618e-4655-4b1f-8c0f-30077456ab98
91002024-08-27T19:11:01.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70240 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 9b399d05-a0c2-4a9f-a8a6-9596571b1c71 response_code = 201 uri = /metrics/producers
91012024-08-27T19:11:01.092ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "9b399d05-a0c2-4a9f-a8a6-9596571b1c71", "content-length": "41", "date": "Tue, 27 Aug 2024 19:11:01 GMT"} })
91022024-08-27T19:11:01.093ZDEBGnexus (producer-registration-task): registered with nexus successfully
91032024-08-27T19:11:01.093ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
91042024-08-27T19:11:01.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 670cf62d-b15b-4f69-b906-ec0f8476fc50 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91052024-08-27T19:11:01.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 670cf62d-b15b-4f69-b906-ec0f8476fc50 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91062024-08-27T19:11:01.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 670cf62d-b15b-4f69-b906-ec0f8476fc50 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91072024-08-27T19:11:03.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcdb3b82-967b-49ad-a741-345cc58c6960 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91082024-08-27T19:11:03.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcdb3b82-967b-49ad-a741-345cc58c6960 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91092024-08-27T19:11:03.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bcdb3b82-967b-49ad-a741-345cc58c6960 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91102024-08-27T19:11:04.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6bf9f83-0c30-42db-a4ed-6f070c2d9738 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91112024-08-27T19:11:04.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6bf9f83-0c30-42db-a4ed-6f070c2d9738 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91122024-08-27T19:11:04.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f6bf9f83-0c30-42db-a4ed-6f070c2d9738 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91132024-08-27T19:11:05.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ee18102-3c41-4383-9fe9-3dc63557ce3f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91142024-08-27T19:11:05.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ee18102-3c41-4383-9fe9-3dc63557ce3f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91152024-08-27T19:11:05.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 2ee18102-3c41-4383-9fe9-3dc63557ce3f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91162024-08-27T19:11:06.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c095150e-8c32-42bf-846d-fc2fac3258e7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91172024-08-27T19:11:06.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c095150e-8c32-42bf-846d-fc2fac3258e7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91182024-08-27T19:11:06.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c095150e-8c32-42bf-846d-fc2fac3258e7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91192024-08-27T19:11:07.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abe25eef-0c3c-4a35-9197-946d08175ec1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91202024-08-27T19:11:07.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abe25eef-0c3c-4a35-9197-946d08175ec1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91212024-08-27T19:11:07.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = abe25eef-0c3c-4a35-9197-946d08175ec1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91222024-08-27T19:11:08.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 549e693a-ad79-473d-825e-cb0ee0453fda roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91232024-08-27T19:11:08.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 549e693a-ad79-473d-825e-cb0ee0453fda resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91242024-08-27T19:11:08.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 549e693a-ad79-473d-825e-cb0ee0453fda response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91252024-08-27T19:11:09.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160fc410-13e6-481c-88eb-decc867a2757 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91262024-08-27T19:11:09.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160fc410-13e6-481c-88eb-decc867a2757 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91272024-08-27T19:11:09.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 160fc410-13e6-481c-88eb-decc867a2757 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91282024-08-27T19:11:10.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73ab81ae-c641-4e6a-a1be-5cdef04a11f9 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91292024-08-27T19:11:10.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73ab81ae-c641-4e6a-a1be-5cdef04a11f9 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91302024-08-27T19:11:10.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 73ab81ae-c641-4e6a-a1be-5cdef04a11f9 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91312024-08-27T19:11:10.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
91322024-08-27T19:11:10.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91332024-08-27T19:11:10.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
91342024-08-27T19:11:10.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91352024-08-27T19:11:10.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91362024-08-27T19:11:10.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91372024-08-27T19:11:10.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91382024-08-27T19:11:10.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91392024-08-27T19:11:10.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91402024-08-27T19:11:10.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.206235ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91412024-08-27T19:11:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91422024-08-27T19:11:10.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91432024-08-27T19:11:10.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91442024-08-27T19:11:10.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91452024-08-27T19:11:10.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91462024-08-27T19:11:10.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91472024-08-27T19:11:10.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
91482024-08-27T19:11:10.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91492024-08-27T19:11:10.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91502024-08-27T19:11:10.246ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
91512024-08-27T19:11:10.246ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.220311ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
91522024-08-27T19:11:11.091ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 608 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = fc9b3907-62bd-455c-8fe4-8783824e9745 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
91532024-08-27T19:11:11.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6421e70b-38a2-42d3-a37d-986e1babd318 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91542024-08-27T19:11:11.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6421e70b-38a2-42d3-a37d-986e1babd318 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91552024-08-27T19:11:11.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 6421e70b-38a2-42d3-a37d-986e1babd318 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91562024-08-27T19:11:12.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 687482a1-8e0e-46e1-8b3d-30530954a692 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91572024-08-27T19:11:12.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 687482a1-8e0e-46e1-8b3d-30530954a692 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91582024-08-27T19:11:12.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 687482a1-8e0e-46e1-8b3d-30530954a692 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91592024-08-27T19:11:13.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5cdda97-0a4c-4319-b70b-e3bcadf182f1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91602024-08-27T19:11:13.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5cdda97-0a4c-4319-b70b-e3bcadf182f1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91612024-08-27T19:11:13.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = b5cdda97-0a4c-4319-b70b-e3bcadf182f1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91622024-08-27T19:11:14.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb4a961d-d653-4a3b-95a5-1757be03247f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91632024-08-27T19:11:14.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb4a961d-d653-4a3b-95a5-1757be03247f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91642024-08-27T19:11:14.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb4a961d-d653-4a3b-95a5-1757be03247f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91652024-08-27T19:11:15.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f540defa-c00e-49d1-b7b6-5f0953f7a26e roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91662024-08-27T19:11:15.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f540defa-c00e-49d1-b7b6-5f0953f7a26e resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91672024-08-27T19:11:15.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f540defa-c00e-49d1-b7b6-5f0953f7a26e response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91682024-08-27T19:11:16.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f72ec180-5772-44d6-a1aa-a9456493a83f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91692024-08-27T19:11:16.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f72ec180-5772-44d6-a1aa-a9456493a83f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91702024-08-27T19:11:16.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f72ec180-5772-44d6-a1aa-a9456493a83f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91712024-08-27T19:11:17.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbf477b8-b85a-4a92-aa6b-cc1e9b6d327a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91722024-08-27T19:11:17.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbf477b8-b85a-4a92-aa6b-cc1e9b6d327a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91732024-08-27T19:11:17.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = fbf477b8-b85a-4a92-aa6b-cc1e9b6d327a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91742024-08-27T19:11:18.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7adc2dd1-8224-4503-89cd-8eb56534f395 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91752024-08-27T19:11:18.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7adc2dd1-8224-4503-89cd-8eb56534f395 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91762024-08-27T19:11:18.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7adc2dd1-8224-4503-89cd-8eb56534f395 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91772024-08-27T19:11:18.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = c1c73869-8411-465f-a6c4-3aa5fec620f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
91782024-08-27T19:11:18.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = c1c73869-8411-465f-a6c4-3aa5fec620f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
91792024-08-27T19:11:18.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42930 req_id = c1c73869-8411-465f-a6c4-3aa5fec620f0 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
91802024-08-27T19:11:19.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c51c0245-73c0-4706-b629-8645d84b6f9a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91812024-08-27T19:11:19.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c51c0245-73c0-4706-b629-8645d84b6f9a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91822024-08-27T19:11:19.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c51c0245-73c0-4706-b629-8645d84b6f9a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
91832024-08-27T19:11:20.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
91842024-08-27T19:11:20.230ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
91852024-08-27T19:11:20.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91862024-08-27T19:11:20.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91872024-08-27T19:11:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91882024-08-27T19:11:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892024-08-27T19:11:20.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91902024-08-27T19:11:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91912024-08-27T19:11:20.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91922024-08-27T19:11:20.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.042932ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91932024-08-27T19:11:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91942024-08-27T19:11:20.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91952024-08-27T19:11:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91962024-08-27T19:11:20.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91972024-08-27T19:11:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91982024-08-27T19:11:20.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-08-27T19:11:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
92002024-08-27T19:11:20.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92012024-08-27T19:11:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92022024-08-27T19:11:20.246ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
92032024-08-27T19:11:20.246ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.562608ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
92042024-08-27T19:11:20.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c049419f-3931-4ff2-85bb-e7ac77860520 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92052024-08-27T19:11:20.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c049419f-3931-4ff2-85bb-e7ac77860520 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92062024-08-27T19:11:20.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c049419f-3931-4ff2-85bb-e7ac77860520 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92072024-08-27T19:11:21.091ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 648 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = ce966f1e-e206-44bc-a7a6-4c2704b8a343 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
92082024-08-27T19:11:21.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 44aad874-041b-431f-8cd5-19f483e24c0d roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92092024-08-27T19:11:21.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 44aad874-041b-431f-8cd5-19f483e24c0d resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92102024-08-27T19:11:21.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 44aad874-041b-431f-8cd5-19f483e24c0d response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92112024-08-27T19:11:22.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c9241c76-6360-401d-9f41-8ce9e93471e3 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92122024-08-27T19:11:22.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c9241c76-6360-401d-9f41-8ce9e93471e3 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92132024-08-27T19:11:22.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = c9241c76-6360-401d-9f41-8ce9e93471e3 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92142024-08-27T19:11:23.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93235573-945d-471a-a4c1-13cd64d99888 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92152024-08-27T19:11:23.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93235573-945d-471a-a4c1-13cd64d99888 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92162024-08-27T19:11:23.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 93235573-945d-471a-a4c1-13cd64d99888 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92172024-08-27T19:11:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4063ca0d-dabe-4c3d-b551-956e26c0ae61 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92182024-08-27T19:11:24.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4063ca0d-dabe-4c3d-b551-956e26c0ae61 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92192024-08-27T19:11:24.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4063ca0d-dabe-4c3d-b551-956e26c0ae61 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92202024-08-27T19:11:25.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5ee9292d-d31f-4989-8e72-97b39b41ee6a roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92212024-08-27T19:11:25.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5ee9292d-d31f-4989-8e72-97b39b41ee6a resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92222024-08-27T19:11:25.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 5ee9292d-d31f-4989-8e72-97b39b41ee6a response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92232024-08-27T19:11:26.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4136e10a-4386-4e15-bf49-b029547fbde7 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92242024-08-27T19:11:26.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4136e10a-4386-4e15-bf49-b029547fbde7 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92252024-08-27T19:11:26.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 4136e10a-4386-4e15-bf49-b029547fbde7 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92262024-08-27T19:11:27.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ce80e879-c050-475f-8274-aeca2bb51c79 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92272024-08-27T19:11:27.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ce80e879-c050-475f-8274-aeca2bb51c79 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92282024-08-27T19:11:27.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = ce80e879-c050-475f-8274-aeca2bb51c79 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92292024-08-27T19:11:28.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64109475-e437-43cf-83c4-646a6099f3d2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92302024-08-27T19:11:28.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64109475-e437-43cf-83c4-646a6099f3d2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92312024-08-27T19:11:28.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 64109475-e437-43cf-83c4-646a6099f3d2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92322024-08-27T19:11:29.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf1e66da-aa55-4236-b2eb-fddc9a9cdbb2 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92332024-08-27T19:11:29.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf1e66da-aa55-4236-b2eb-fddc9a9cdbb2 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92342024-08-27T19:11:29.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bf1e66da-aa55-4236-b2eb-fddc9a9cdbb2 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
92352024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
92362024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
92372024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92382024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
92392024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
92402024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92412024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
92422024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
92432024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92442024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
92452024-08-27T19:11:30.231ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-27 19:01:30.231779965 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92462024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92472024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
92482024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
92492024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
92502024-08-27T19:11:30.231ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a
92512024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.34\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a"}
92522024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92532024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
92542024-08-27T19:11:30.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
92552024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92562024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92572024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92582024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
92592024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92602024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
92612024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92622024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
92632024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92642024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
92652024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
92662024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
92672024-08-27T19:11:30.232ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92682024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
92692024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92702024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92712024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92722024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
92732024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92742024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92752024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
92762024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92772024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92782024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
92792024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92802024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
92812024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92822024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
92832024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92842024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
92852024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92862024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
92872024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92882024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
92892024-08-27T19:11:30.232ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
92902024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
92912024-08-27T19:11:30.232ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
92922024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92932024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92942024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
92952024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92962024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92972024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92982024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92992024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93002024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93012024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93022024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93032024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93042024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93052024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93062024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93072024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93082024-08-27T19:11:30.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5b9ebccd-158f-465d-9f58-f826eef0b95b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f5aef115-6099-4bcb-838b-81bfab4449ed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 884662415 } })
93092024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93102024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93112024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93122024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93132024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93142024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93152024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93162024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93172024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93182024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93192024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93202024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93212024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93222024-08-27T19:11:30.232ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93232024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93242024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93252024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93262024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93272024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93282024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93292024-08-27T19:11:30.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93302024-08-27T19:11:30.234ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28126e25-07e2-4032-8ea4-b0e36ed725b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 886136915 } })
93312024-08-27T19:11:30.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93322024-08-27T19:11:30.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93332024-08-27T19:11:30.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93342024-08-27T19:11:30.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93352024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.059923ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93362024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
93372024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.671225ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
93382024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93392024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402024-08-27T19:11:30.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93412024-08-27T19:11:30.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422024-08-27T19:11:30.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93432024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93442024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93452024-08-27T19:11:30.237ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-27 19:01:30.231779965 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93462024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.235067ms iteration = 10 status = {"expiration":"2024-08-27T19:01:30.231779965Z","pruned":[]}
93472024-08-27T19:11:30.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 889285880 } })
93482024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
93492024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.42939ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
93502024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93512024-08-27T19:11:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.736157ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93522024-08-27T19:11:30.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
93532024-08-27T19:11:30.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 890426653 } })
93542024-08-27T19:11:30.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93552024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93562024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93572024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93582024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93592024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93602024-08-27T19:11:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93612024-08-27T19:11:30.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
93622024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93632024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93642024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93652024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93662024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93672024-08-27T19:11:30.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93682024-08-27T19:11:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93692024-08-27T19:11:30.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-08-27T19:11:30.247ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.117609ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
93712024-08-27T19:11:30.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93722024-08-27T19:11:30.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93732024-08-27T19:11:30.247ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
93742024-08-27T19:11:30.247ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
93752024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
93762024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93772024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93782024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93792024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93802024-08-27T19:11:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93812024-08-27T19:11:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93822024-08-27T19:11:30.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93832024-08-27T19:11:30.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93842024-08-27T19:11:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.204842ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
93852024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93862024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93872024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93882024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93892024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93902024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93912024-08-27T19:11:30.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93922024-08-27T19:11:30.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 21.05295ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
93932024-08-27T19:11:30.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.151081ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93942024-08-27T19:11:30.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93952024-08-27T19:11:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93962024-08-27T19:11:30.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93972024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93982024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93992024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94002024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94012024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94022024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94032024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94042024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94052024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94062024-08-27T19:11:30.255ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
94072024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94082024-08-27T19:11:30.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94092024-08-27T19:11:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94102024-08-27T19:11:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94112024-08-27T19:11:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94122024-08-27T19:11:30.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94132024-08-27T19:11:30.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94142024-08-27T19:11:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94152024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-08-27T19:11:30.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e38b401b-2d22-4589-ac73-fc644b0a15b2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 910428361 } })
94172024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94182024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 0 version = 2
94192024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94202024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94212024-08-27T19:11:30.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94222024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
94232024-08-27T19:11:30.259ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
94242024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94252024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94262024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.832048ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
94272024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94282024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94292024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94302024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94312024-08-27T19:11:30.259ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
94322024-08-27T19:11:30.259ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94332024-08-27T19:11:30.259ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 27.767007ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
94342024-08-27T19:11:30.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
94352024-08-27T19:11:30.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94362024-08-27T19:11:30.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94372024-08-27T19:11:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94382024-08-27T19:11:30.261ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94392024-08-27T19:11:30.261ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
94402024-08-27T19:11:30.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 29.540353ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94412024-08-27T19:11:30.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94422024-08-27T19:11:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94432024-08-27T19:11:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94442024-08-27T19:11:30.262ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94452024-08-27T19:11:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94462024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94472024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94482024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94492024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94502024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94512024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94522024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94532024-08-27T19:11:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94542024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94552024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94562024-08-27T19:11:30.264ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94572024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94582024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.233398ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94592024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94602024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94612024-08-27T19:11:30.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94622024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94632024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94642024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94652024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94662024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94672024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94682024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94692024-08-27T19:11:30.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94702024-08-27T19:11:30.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94712024-08-27T19:11:30.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94722024-08-27T19:11:30.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94732024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6513ec51-0d40-4f22-a504-0050add760f4 dns_zone_name = oxide.test found_so_far = 1 version = 2
94742024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94752024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-27 19:02:59.645875 UTC dns_group = external generation = 2
94762024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 35.239459ms iteration = 10 status = {"generation":2}
94772024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94782024-08-27T19:11:30.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94802024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94812024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94822024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94832024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94842024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94852024-08-27T19:11:30.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94862024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94872024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94882024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a, lookup_type: ById(66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a) } result = Ok(())
94892024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94902024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94912024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94922024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94932024-08-27T19:11:30.270ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94942024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94952024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94962024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94972024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94982024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94992024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95002024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95012024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95022024-08-27T19:11:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 39.821083ms iteration = 5 status = {"nsuccess":5}
95032024-08-27T19:11:30.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95042024-08-27T19:11:30.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95052024-08-27T19:11:30.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95062024-08-27T19:11:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95072024-08-27T19:11:30.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95082024-08-27T19:11:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95092024-08-27T19:11:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95102024-08-27T19:11:30.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95112024-08-27T19:11:30.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95122024-08-27T19:11:30.277ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a original_time_created = 2024-08-27 19:02:13.245056 UTC target_id = 66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a time_created = 2024-08-27 19:02:13.245056 UTC
95132024-08-27T19:11:30.277ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.797965ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"66a46fa1-6de8-4d3d-8fa2-9444b62a1d6a","time_created":"2024-08-27T19:02:13.245056Z"}
95142024-08-27T19:11:30.278ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1157f435-c241-4fe5-8c06-83c9e1f52f13 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
95152024-08-27T19:11:30.278ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
95162024-08-27T19:11:30.278ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-27 19:02:59.160929 UTC dns_group = internal generation = 1
95172024-08-27T19:11:30.278ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 46.354276ms iteration = 10 status = {"generation":1}
95182024-08-27T19:11:30.278ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.606101ms iteration = 21 status = {"physical_disks_added":0}
95192024-08-27T19:11:30.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95202024-08-27T19:11:30.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95212024-08-27T19:11:30.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95222024-08-27T19:11:30.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95232024-08-27T19:11:30.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95242024-08-27T19:11:30.289ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
95252024-08-27T19:11:30.289ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
95262024-08-27T19:11:30.289ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 57.694837ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
95272024-08-27T19:11:30.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e38b401b-2d22-4589-ac73-fc644b0a15b2, lookup_type: ById(e38b401b-2d22-4589-ac73-fc644b0a15b2) } result = Ok(())
95282024-08-27T19:11:30.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95292024-08-27T19:11:30.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95302024-08-27T19:11:30.293ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.663998ms iteration = 19 status = 0
95312024-08-27T19:11:30.306ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-27T19:02:29.735395Z, time_modified: 2024-08-27T19:02:29.735395Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, db_silo: Silo { identity: SiloIdentity { id: d5f4de10-86a1-47de-980c-717d10d0f131, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-27T19:02:59.612616Z, time_modified: 2024-08-27T19:02:59.612616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07" }] }) }
95322024-08-27T19:11:30.306ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 75.049981ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]}},"default_endpoint":{"silo_id":"d5f4de10-86a1-47de-980c-717d10d0f131","tls_certs":["cedbf7a0081d58350fd1d48da830d86c32d63ccb13799c98c1f8173b33ea2c07"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95332024-08-27T19:11:30.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
95342024-08-27T19:11:30.397ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
95352024-08-27T19:11:30.397ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95362024-08-27T19:11:30.398ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "964a90e9-62c5-4fd6-aa1f-d8d22cfd01ff", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95372024-08-27T19:11:30.398ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95382024-08-27T19:11:30.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95392024-08-27T19:11:30.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95402024-08-27T19:11:30.445ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
95412024-08-27T19:11:30.445ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95422024-08-27T19:11:30.446ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93dd1785-20a5-4a13-aab8-2a57168f3d7f", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95432024-08-27T19:11:30.446ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95442024-08-27T19:11:30.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95452024-08-27T19:11:30.474ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95462024-08-27T19:11:30.475ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6be7ed-43bd-4c26-98c5-50ff994f8724", "content-length": "372", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95472024-08-27T19:11:30.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95482024-08-27T19:11:30.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95492024-08-27T19:11:30.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95502024-08-27T19:11:30.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95512024-08-27T19:11:30.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95522024-08-27T19:11:30.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95532024-08-27T19:11:30.481ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 zone_address = fd00:1122:3344:101::2
95542024-08-27T19:11:30.481ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95552024-08-27T19:11:30.482ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "736be75a-6d49-4073-967e-5e6b671c8f00", "content-length": "26", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95562024-08-27T19:11:30.482ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95572024-08-27T19:11:30.482ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95582024-08-27T19:11:30.482ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b7bdf52b-8c26-4593-9c06-c003c4bbd819", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95592024-08-27T19:11:30.484ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
95602024-08-27T19:11:30.484ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 252.473253ms iteration = 20 status = {}
95612024-08-27T19:11:30.490ZDEBGnexus (BackgroundTasks): client request SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95622024-08-27T19:11:30.491ZDEBGnexus (BackgroundTasks): client response SledAgent = e38b401b-2d22-4589-ac73-fc644b0a15b2 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "491c32d0-07ed-4e9b-b435-fc6391842e89", "content-length": "691", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95632024-08-27T19:11:30.491ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95642024-08-27T19:11:30.491ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95652024-08-27T19:11:30.491ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95662024-08-27T19:11:30.493ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.526197ms iteration = 20 status = {}
95672024-08-27T19:11:30.536ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95682024-08-27T19:11:30.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bab3b1ff-5c0b-429c-b495-722aea7f114d", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95692024-08-27T19:11:30.536ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95702024-08-27T19:11:30.539ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89a7f48b-f191-415b-b2e4-9bd5160a9382", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95712024-08-27T19:11:30.539ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95722024-08-27T19:11:30.540ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95732024-08-27T19:11:30.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 308.795782ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95742024-08-27T19:11:30.546ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 314.566029ms iteration = 19 status = {}
95752024-08-27T19:11:30.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95762024-08-27T19:11:30.558ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95772024-08-27T19:11:30.559ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a8064dd-7823-42cb-b5fc-e402da757d29", "content-length": "2", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
95782024-08-27T19:11:30.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95792024-08-27T19:11:30.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95802024-08-27T19:11:30.563ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.519036ms iteration = 19 status = null
95812024-08-27T19:11:30.591ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95822024-08-27T19:11:30.592ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "df4d7263-8265-4743-81c4-6808b78ce18e", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95832024-08-27T19:11:30.592ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95842024-08-27T19:11:30.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ff93e3d7-6f52-4cd5-be20-f27fb348fc16", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95852024-08-27T19:11:30.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95862024-08-27T19:11:30.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 24245c26-317f-471e-baf5-67f4ce3cf790 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
95872024-08-27T19:11:30.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 24245c26-317f-471e-baf5-67f4ce3cf790 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
95882024-08-27T19:11:30.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 24245c26-317f-471e-baf5-67f4ce3cf790 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
95892024-08-27T19:11:30.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "88b2cd3d-08e7-4998-8b4b-3faa899c6b07", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95902024-08-27T19:11:30.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95912024-08-27T19:11:30.598ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95922024-08-27T19:11:30.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 366.766725ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95932024-08-27T19:11:30.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95942024-08-27T19:11:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95952024-08-27T19:11:30.639ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: dd6f6b8d-22df-40fd-b9e3-f2f7cff270ad, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a819d57d-7d55-4e8d-8670-883e98a2190e) } rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
95962024-08-27T19:11:30.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95972024-08-27T19:11:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95982024-08-27T19:11:30.646ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95992024-08-27T19:11:30.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4dc9b09-e030-4591-a6a3-ddbb8035cdd2", "content-length": "121", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
96002024-08-27T19:11:30.646ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
96012024-08-27T19:11:30.646ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a819d57d-7d55-4e8d-8670-883e98a2190e
96022024-08-27T19:11:30.646ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96032024-08-27T19:11:30.647ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96042024-08-27T19:11:30.647ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
96052024-08-27T19:11:30.647ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 routes = {}
96062024-08-27T19:11:30.647ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991
96072024-08-27T19:11:30.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96082024-08-27T19:11:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96092024-08-27T19:11:30.648ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96102024-08-27T19:11:30.648ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1c720bd7-42ce-45a4-a0c3-52727c61aab6", "content-length": "2", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
96112024-08-27T19:11:30.648ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96122024-08-27T19:11:30.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22db5a38-3e68-4710-aa5a-b6a2bbf32c8a", "content-length": "52", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
96132024-08-27T19:11:30.649ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch_location = Switch0
96142024-08-27T19:11:30.649ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96152024-08-27T19:11:30.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6477847b-ab6d-4d6f-96e8-6b7d17028fa7", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
96162024-08-27T19:11:30.743ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 switch = Switch0
96172024-08-27T19:11:30.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96182024-08-27T19:11:30.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c74aab71-8e38-4613-a469-5ba1cc230991 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3029e7c-e26d-4af0-80f1-adca1f84f830", "content-length": "667", "date": "Tue, 27 Aug 2024 19:11:30 GMT"} })
96192024-08-27T19:11:30.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96202024-08-27T19:11:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96212024-08-27T19:11:30.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96222024-08-27T19:11:30.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96232024-08-27T19:11:30.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96242024-08-27T19:11:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96252024-08-27T19:11:30.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96262024-08-27T19:11:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96272024-08-27T19:11:30.758ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 526.424833ms iteration = 19 status = {}
96282024-08-27T19:11:31.092ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 724 local_addr = [fd00:1122:3344:101::b]:40792 method = GET remote_addr = [fd00:1122:3344:101::d]:33073 req_id = 3690473b-880b-4e36-84fd-a288b2bf8996 response_code = 200 uri = /8f71618e-4655-4b1f-8c0f-30077456ab98
96292024-08-27T19:11:31.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dea08f8f-6a1c-4f43-ac03-0559b4306784 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96302024-08-27T19:11:31.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dea08f8f-6a1c-4f43-ac03-0559b4306784 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96312024-08-27T19:11:31.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = dea08f8f-6a1c-4f43-ac03-0559b4306784 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96322024-08-27T19:11:32.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 43af3f3c-6c9c-41b8-a93f-fa3ee10d4acb roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96332024-08-27T19:11:32.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 43af3f3c-6c9c-41b8-a93f-fa3ee10d4acb resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96342024-08-27T19:11:32.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 43af3f3c-6c9c-41b8-a93f-fa3ee10d4acb response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96352024-08-27T19:11:33.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f2da342d-24a9-4817-9a66-e7e2e105ddd1 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96362024-08-27T19:11:33.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f2da342d-24a9-4817-9a66-e7e2e105ddd1 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96372024-08-27T19:11:33.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = f2da342d-24a9-4817-9a66-e7e2e105ddd1 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96382024-08-27T19:11:34.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d1c0f02a-4405-4b2a-a799-69ae7156205c roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96392024-08-27T19:11:34.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d1c0f02a-4405-4b2a-a799-69ae7156205c resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96402024-08-27T19:11:34.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d1c0f02a-4405-4b2a-a799-69ae7156205c response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96412024-08-27T19:11:35.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d11569f9-9a2e-4b11-a6f0-5a6bc0b69c4f roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96422024-08-27T19:11:35.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d11569f9-9a2e-4b11-a6f0-5a6bc0b69c4f resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96432024-08-27T19:11:35.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = d11569f9-9a2e-4b11-a6f0-5a6bc0b69c4f response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96442024-08-27T19:11:36.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bd97370-7bc1-4ddf-ae02-d6a68d6eda04 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96452024-08-27T19:11:36.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bd97370-7bc1-4ddf-ae02-d6a68d6eda04 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96462024-08-27T19:11:36.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 1bd97370-7bc1-4ddf-ae02-d6a68d6eda04 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96472024-08-27T19:11:37.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb796487-14ff-47ac-b780-465184ec01f8 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96482024-08-27T19:11:37.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb796487-14ff-47ac-b780-465184ec01f8 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96492024-08-27T19:11:37.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = bb796487-14ff-47ac-b780-465184ec01f8 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96502024-08-27T19:11:38.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7fef4db0-6f50-468d-9fe7-9ec54cbdd675 roles = RoleSet { roles: {} } uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96512024-08-27T19:11:38.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7fef4db0-6f50-468d-9fe7-9ec54cbdd675 resource = Database result = Ok(()) uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2
96522024-08-27T19:11:38.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38934 req_id = 7fef4db0-6f50-468d-9fe7-9ec54cbdd675 response_code = 200 uri = /probes/e38b401b-2d22-4589-ac73-fc644b0a15b2