Max level shown:
1 [ Dec 21 07:47:09 Enabled. ]
2 [ Dec 21 07:47:09 Rereading configuration. ]
3 [ Dec 21 07:47:12 Rereading configuration. ]
4 [ Dec 21 07:47:19 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Dec 21 07:47:19 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T07:47:19.906ZDEBGnexus: registered DTrace probes
82024-12-21T07:47:19.908ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-12-21T07:47:19.917ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-12-21T07:47:19.917ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-12-21T07:47:19.936ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-12-21T07:47:19.939ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-12-21T07:47:19.944ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-12-21T07:47:19.948ZDEBGnexus (ServerContext): registered USDT probes
672024-12-21T07:47:20.060ZINFOnexus: Database schema version is up to date desired_version = 117.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 117.0.0
682024-12-21T07:47:20.062ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
692024-12-21T07:47:20.068ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 960, tv_nsec: 23407048 } })
702024-12-21T07:47:20.072ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-12-21T07:47:20.123ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-12-21T07:47:20.123ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-12-21T07:47:20.126ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae80a01d-f624-46dc-9e99-7e3843a67265", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:20 GMT"} })
742024-12-21T07:47:20.126ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-12-21T07:47:20.127ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-12-21T07:47:20.158ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 960, tv_nsec: 113333231 } })
772024-12-21T07:47:20.158ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-12-21T07:47:20.190ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-12-21T07:47:20.190ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-12-21T07:47:20.191ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12c8b293-c8c1-4c4f-bc94-7fdcb5910c22", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:20 GMT"} })
812024-12-21T07:47:20.191ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-12-21T07:47:20.191ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-12-21T07:47:20.257ZDEBGnexus (clickhouse-client): registered USDT probes id = 7d81f2b2-84d5-442a-9763-3f9c674eca19
842024-12-21T07:47:20.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-12-21T07:47:20.273ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-12-21T07:47:20.291ZDEBGnexus (DataLoader): attempting to create built-in users
872024-12-21T07:47:20.291ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-12-21T07:47:20.291ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-12-21T07:47:20.300ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-12-21T07:47:20.301ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1322024-12-21T07:47:20.301ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1332024-12-21T07:47:20.301ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-12-21T07:47:20.301ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-12-21T07:47:20.671ZWARNnexus: Cannot look up rack: Object (of type ById(5b228607-94ff-4bfc-99d8-b10385e90443)) not found: rack file = nexus/src/app/rack.rs:774
1362024-12-21T07:47:20.707ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-12-21T07:47:20.707ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-12-21T07:47:20.708ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-12-21T07:47:20.708ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-12-21T07:47:20.708ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-12-21T07:47:20.708ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-12-21T07:47:20.805ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:52412
1432024-12-21T07:47:20.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:52412 req_id = e40916b2-d976-48a6-bd15-22a8dcad85f1 roles = RoleSet { roles: {} } uri = /metrics/collectors
1442024-12-21T07:47:20.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:52412 req_id = e40916b2-d976-48a6-bd15-22a8dcad85f1 resource = Database result = Ok(()) uri = /metrics/collectors
1452024-12-21T07:47:20.876ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:41
1462024-12-21T07:47:20.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70942 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:52412 req_id = e40916b2-d976-48a6-bd15-22a8dcad85f1 response_code = 204 uri = /metrics/collectors
1472024-12-21T07:47:20.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 70460a5e-01cc-4198-abe3-f8d41a1a07e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
1482024-12-21T07:47:20.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 70460a5e-01cc-4198-abe3-f8d41a1a07e8 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
1492024-12-21T07:47:20.901ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1502024-12-21T07:47:20.901ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-12-21T07:47:20.902ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-12-21T07:47:20.902ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1532024-12-21T07:47:20.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-12-21T07:47:20.902ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-12-21T07:47:21.109ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58681
1562024-12-21T07:47:21.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 941d9d45-2875-46c8-9cbc-dc081fb4c83d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1572024-12-21T07:47:21.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 941d9d45-2875-46c8-9cbc-dc081fb4c83d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1582024-12-21T07:47:21.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 941d9d45-2875-46c8-9cbc-dc081fb4c83d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1592024-12-21T07:47:21.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 70460a5e-01cc-4198-abe3-f8d41a1a07e8 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
1602024-12-21T07:47:21.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5847e9b5-6ff0-4c2a-a145-743831697cc3 roles = RoleSet { roles: {} } uri = /sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1612024-12-21T07:47:21.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5847e9b5-6ff0-4c2a-a145-743831697cc3 resource = Database result = Ok(()) uri = /sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1622024-12-21T07:47:21.284ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "c992e3dc-2d80-4655-85d0-78e9a80bf69e" error_message_internal = not found: sled with id "c992e3dc-2d80-4655-85d0-78e9a80bf69e" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 107157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5847e9b5-6ff0-4c2a-a145-743831697cc3 response_code = 404 uri = /sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1632024-12-21T07:47:21.573ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1642024-12-21T07:47:21.573ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-12-21T07:47:21.574ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-12-21T07:47:21.574ZDEBGnexus (DataLoader): attempting to create built-in silos
1672024-12-21T07:47:21.574ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-12-21T07:47:21.574ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-12-21T07:47:22.120ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1702024-12-21T07:47:22.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-12-21T07:47:22.121ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-12-21T07:47:22.169ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-12-21T07:47:22.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bd1e971-7aed-4fa3-ab77-2e95cd067252 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1742024-12-21T07:47:22.171ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-12-21T07:47:22.171ZDEBGnexus (DataLoader): attempting to create built-in projects
1762024-12-21T07:47:22.171ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-12-21T07:47:22.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bd1e971-7aed-4fa3-ab77-2e95cd067252 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1782024-12-21T07:47:22.171ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-12-21T07:47:22.176ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-12-21T07:47:22.176ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-12-21T07:47:22.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bd1e971-7aed-4fa3-ab77-2e95cd067252 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
1822024-12-21T07:47:22.318ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-12-21T07:47:22.319ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-12-21T07:47:22.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-12-21T07:47:22.372ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1862024-12-21T07:47:22.372ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-12-21T07:47:22.372ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882024-12-21T07:47:22.379ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-12-21T07:47:22.380ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-12-21T07:47:22.381ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-12-21T07:47:22.383ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1922024-12-21T07:47:22.383ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-12-21T07:47:22.383ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-12-21T07:47:22.472ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1952024-12-21T07:47:22.473ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-12-21T07:47:22.473ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-12-21T07:47:22.473ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1982024-12-21T07:47:22.474ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-12-21T07:47:22.474ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-12-21T07:47:22.483ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-12-21T07:47:22.483ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-12-21T07:47:22.485ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-12-21T07:47:22.485ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-12-21T07:47:22.487ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-12-21T07:47:22.487ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-12-21T07:47:22.536ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-12-21T07:47:22.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-12-21T07:47:22.538ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-12-21T07:47:22.541ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2102024-12-21T07:47:22.541ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-12-21T07:47:22.541ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-12-21T07:47:22.542ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-12-21T07:47:22.542ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-12-21T07:47:22.672ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2152024-12-21T07:47:22.672ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2162024-12-21T07:47:22.682ZWARNnexus: Cannot look up rack: Object (of type ById(5b228607-94ff-4bfc-99d8-b10385e90443)) not found: rack file = nexus/src/app/rack.rs:774
2172024-12-21T07:47:22.727ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-12-21T07:47:22.727ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-12-21T07:47:22.729ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-12-21T07:47:22.732ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2212024-12-21T07:47:22.732ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-12-21T07:47:22.732ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-12-21T07:47:22.750ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-12-21T07:47:22.750ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-12-21T07:47:22.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-12-21T07:47:22.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-12-21T07:47:22.753ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-12-21T07:47:22.753ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-12-21T07:47:22.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-12-21T07:47:22.758ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2312024-12-21T07:47:22.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-12-21T07:47:22.758ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-12-21T07:47:22.768ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-12-21T07:47:22.768ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-12-21T07:47:22.776ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-12-21T07:47:22.776ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-12-21T07:47:22.785ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-12-21T07:47:22.786ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-12-21T07:47:22.787ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-12-21T07:47:22.787ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-12-21T07:47:22.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-12-21T07:47:22.789ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-12-21T07:47:22.790ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-12-21T07:47:22.793ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2452024-12-21T07:47:22.793ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-12-21T07:47:22.793ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-12-21T07:47:22.839ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-12-21T07:47:22.840ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-12-21T07:47:22.841ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-12-21T07:47:22.841ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-12-21T07:47:22.843ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-12-21T07:47:22.843ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-12-21T07:47:22.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-12-21T07:47:22.848ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2552024-12-21T07:47:22.848ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-12-21T07:47:22.848ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-12-21T07:47:22.904ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-12-21T07:47:22.904ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-12-21T07:47:22.906ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-12-21T07:47:22.906ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-12-21T07:47:22.907ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-12-21T07:47:22.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632024-12-21T07:47:22.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-12-21T07:47:22.912ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2652024-12-21T07:47:22.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-12-21T07:47:22.912ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-12-21T07:47:22.955ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2682024-12-21T07:47:22.955ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-12-21T07:47:22.955ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-12-21T07:47:22.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-12-21T07:47:22.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722024-12-21T07:47:22.958ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-12-21T07:47:22.958ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-12-21T07:47:22.960ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-12-21T07:47:22.960ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-12-21T07:47:22.961ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-12-21T07:47:22.962ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-12-21T07:47:22.963ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-12-21T07:47:22.963ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-12-21T07:47:22.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-12-21T07:47:22.968ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2822024-12-21T07:47:22.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-12-21T07:47:22.968ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-12-21T07:47:22.969ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-12-21T07:47:22.969ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-12-21T07:47:22.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-12-21T07:47:22.971ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-12-21T07:47:22.972ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-12-21T07:47:22.975ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2902024-12-21T07:47:22.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-12-21T07:47:22.976ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-12-21T07:47:22.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-12-21T07:47:22.997ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-12-21T07:47:22.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-12-21T07:47:22.998ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-12-21T07:47:22.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-12-21T07:47:22.999ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-12-21T07:47:23.001ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-12-21T07:47:23.004ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3002024-12-21T07:47:23.004ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-12-21T07:47:23.004ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-12-21T07:47:23.118ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
3032024-12-21T07:47:23.118ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3042024-12-21T07:47:23.118ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-12-21T07:47:23.118ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-12-21T07:47:23.127ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-12-21T07:47:23.127ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-12-21T07:47:23.129ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-12-21T07:47:23.129ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-12-21T07:47:23.131ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-12-21T07:47:23.132ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-12-21T07:47:23.133ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-12-21T07:47:23.133ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-12-21T07:47:23.134ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-12-21T07:47:23.135ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-12-21T07:47:23.136ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-12-21T07:47:23.139ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3182024-12-21T07:47:23.139ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-12-21T07:47:23.140ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-12-21T07:47:23.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-12-21T07:47:23.148ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-12-21T07:47:23.149ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-12-21T07:47:23.149ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-12-21T07:47:23.150ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-12-21T07:47:23.150ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-12-21T07:47:23.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-12-21T07:47:23.154ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3282024-12-21T07:47:23.178ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:56 sled_uuid = c992e3dc-2d80-4655-85d0-78e9a80bf69e
3292024-12-21T07:47:23.204ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-12-21T07:47:23.204ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-12-21T07:47:23.282ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-12-21T07:47:23.282ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332024-12-21T07:47:23.288ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-12-21T07:47:23.288ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-12-21T07:47:23.289ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-12-21T07:47:23.289ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-12-21T07:47:23.291ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-12-21T07:47:23.291ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-12-21T07:47:23.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121659 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 538c88ce-70f4-4068-850e-b0f3d1e2a61c response_code = 204 uri = /sled-agents/c992e3dc-2d80-4655-85d0-78e9a80bf69e
3402024-12-21T07:47:23.320ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-12-21T07:47:23.323ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3422024-12-21T07:47:23.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-12-21T07:47:23.323ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-12-21T07:47:23.330ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-12-21T07:47:23.330ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-12-21T07:47:23.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-12-21T07:47:23.338ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-12-21T07:47:23.340ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-12-21T07:47:23.340ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-12-21T07:47:23.341ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-12-21T07:47:23.341ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-12-21T07:47:23.343ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-12-21T07:47:23.343ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-12-21T07:47:23.344ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-12-21T07:47:23.344ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-12-21T07:47:23.346ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-12-21T07:47:23.346ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-12-21T07:47:23.347ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-12-21T07:47:23.351ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3602024-12-21T07:47:23.351ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-12-21T07:47:23.351ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-12-21T07:47:23.354ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-12-21T07:47:23.354ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-12-21T07:47:23.356ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-12-21T07:47:23.356ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-12-21T07:47:23.359ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-12-21T07:47:23.359ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-12-21T07:47:23.362ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-12-21T07:47:23.362ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-12-21T07:47:23.363ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-12-21T07:47:23.364ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-12-21T07:47:23.365ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-12-21T07:47:23.365ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742024-12-21T07:47:23.366ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-12-21T07:47:23.371ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3762024-12-21T07:47:23.371ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3772024-12-21T07:47:23.371ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3782024-12-21T07:47:23.371ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792024-12-21T07:47:23.371ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3802024-12-21T07:47:23.371ZDEBGnexus (DataLoader): attempting to create silo users
3812024-12-21T07:47:23.371ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822024-12-21T07:47:23.372ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832024-12-21T07:47:23.382ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3842024-12-21T07:47:23.382ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3852024-12-21T07:47:23.382ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-12-21T07:47:23.382ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3872024-12-21T07:47:23.386ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3882024-12-21T07:47:23.386ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3892024-12-21T07:47:23.387ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3902024-12-21T07:47:23.391ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3912024-12-21T07:47:23.391ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3922024-12-21T07:47:23.398ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3932024-12-21T07:47:23.399ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3942024-12-21T07:47:23.400ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3952024-12-21T07:47:23.401ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3962024-12-21T07:47:23.401ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3972024-12-21T07:47:23.401ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3982024-12-21T07:47:23.412ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3992024-12-21T07:47:23.412ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4002024-12-21T07:47:23.413ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4012024-12-21T07:47:23.414ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4022024-12-21T07:47:23.414ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4032024-12-21T07:47:23.414ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4042024-12-21T07:47:23.544ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4052024-12-21T07:47:23.545ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4062024-12-21T07:47:23.569ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
4072024-12-21T07:47:23.569ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
4082024-12-21T07:47:23.574ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Signaled
4092024-12-21T07:47:23.574ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4102024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4112024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4122024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4132024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4142024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4152024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4162024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4172024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4182024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4192024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4202024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4212024-12-21T07:47:23.575ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4222024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4232024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4242024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4252024-12-21T07:47:23.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4262024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4272024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4282024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4292024-12-21T07:47:23.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 109.562\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4302024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4312024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4322024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4332024-12-21T07:47:23.576ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4342024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 57.87\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4352024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4362024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4372024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4382024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4392024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4402024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4412024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4422024-12-21T07:47:23.576ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4432024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4442024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4452024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4462024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4472024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4482024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4492024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4502024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4512024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4522024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4532024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4542024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4552024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4562024-12-21T07:47:23.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4572024-12-21T07:47:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4582024-12-21T07:47:23.578ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4592024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4602024-12-21T07:47:23.578ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:37:23.578471230 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4612024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4622024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4632024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4642024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4652024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4662024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4672024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4682024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4692024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4702024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4712024-12-21T07:47:23.578ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4722024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4732024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 2.482303ms iteration = 1 status = {"error":"no config nor servers"}
4742024-12-21T07:47:23.578ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4752024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 2.531103ms iteration = 1 status = {"error":"no blueprint"}
4762024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4772024-12-21T07:47:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4782024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4792024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4802024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4812024-12-21T07:47:23.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4822024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4832024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4842024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4852024-12-21T07:47:23.579ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4862024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4872024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4882024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4892024-12-21T07:47:23.580ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4902024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4912024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4922024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4932024-12-21T07:47:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4942024-12-21T07:47:23.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4952024-12-21T07:47:23.582ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962024-12-21T07:47:23.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972024-12-21T07:47:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 536045177 } })
4982024-12-21T07:47:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 535828524 } })
4992024-12-21T07:47:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5002024-12-21T07:47:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5012024-12-21T07:47:23.584ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5022024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 8.312403ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5032024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5042024-12-21T07:47:23.584ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5052024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.92\u{b5}s iteration = 2 status = {"error":"no config"}
5062024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5072024-12-21T07:47:23.584ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5082024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 8.653628ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5092024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5102024-12-21T07:47:23.584ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5112024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.3\u{b5}s iteration = 2 status = {"error":"no config"}
5122024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5132024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5142024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5152024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5162024-12-21T07:47:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5172024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5182024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5192024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5202024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5212024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5222024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5232024-12-21T07:47:23.585ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5242024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5252024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5262024-12-21T07:47:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5272024-12-21T07:47:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5282024-12-21T07:47:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5292024-12-21T07:47:23.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5302024-12-21T07:47:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5312024-12-21T07:47:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5322024-12-21T07:47:23.589ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5332024-12-21T07:47:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5342024-12-21T07:47:23.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5352024-12-21T07:47:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5362024-12-21T07:47:23.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5372024-12-21T07:47:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5382024-12-21T07:47:23.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 563446858 } })
5392024-12-21T07:47:23.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5402024-12-21T07:47:23.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412024-12-21T07:47:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5422024-12-21T07:47:23.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-12-21T07:47:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5442024-12-21T07:47:23.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5452024-12-21T07:47:23.624ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 48.463201ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5462024-12-21T07:47:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5472024-12-21T07:47:23.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-12-21T07:47:23.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5492024-12-21T07:47:23.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5502024-12-21T07:47:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5512024-12-21T07:47:23.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 602192382 } })
5522024-12-21T07:47:23.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5532024-12-21T07:47:23.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5542024-12-21T07:47:23.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5552024-12-21T07:47:23.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0305b924-8b90-469a-90c8-8416ad407842", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
5562024-12-21T07:47:23.684ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5572024-12-21T07:47:23.686ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-12-21T07:47:23.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5592024-12-21T07:47:23.688ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:37:23.578471230 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5602024-12-21T07:47:23.688ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 112.602912ms iteration = 1 status = {"expiration":"2024-12-21T07:37:23.578471230Z","pruned":[]}
5612024-12-21T07:47:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5622024-12-21T07:47:23.689ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5632024-12-21T07:47:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5642024-12-21T07:47:23.691ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
5652024-12-21T07:47:23.691ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.493361ms iteration = 1 status = {"error":"rack not yet initialized: 5b228607-94ff-4bfc-99d8-b10385e90443"}
5662024-12-21T07:47:23.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5672024-12-21T07:47:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5682024-12-21T07:47:23.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-12-21T07:47:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5702024-12-21T07:47:23.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5712024-12-21T07:47:23.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5722024-12-21T07:47:23.708ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 132.408021ms iteration = 1 status = {}
5732024-12-21T07:47:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 132.907109ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5742024-12-21T07:47:23.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5752024-12-21T07:47:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5762024-12-21T07:47:23.722ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5772024-12-21T07:47:23.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 145.809781ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5782024-12-21T07:47:23.727ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5792024-12-21T07:47:23.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 683296163 } })
5802024-12-21T07:47:23.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5812024-12-21T07:47:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5822024-12-21T07:47:23.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5832024-12-21T07:47:23.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842024-12-21T07:47:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852024-12-21T07:47:23.732ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5862024-12-21T07:47:23.732ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.695258ms iteration = 1 status = {"error":"inventory collection is None"}
5872024-12-21T07:47:23.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5882024-12-21T07:47:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5892024-12-21T07:47:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 158.080492ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5902024-12-21T07:47:23.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5912024-12-21T07:47:23.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5922024-12-21T07:47:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5932024-12-21T07:47:23.736ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5942024-12-21T07:47:23.736ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5952024-12-21T07:47:23.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5962024-12-21T07:47:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5972024-12-21T07:47:23.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-12-21T07:47:23.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5992024-12-21T07:47:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6002024-12-21T07:47:23.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6012024-12-21T07:47:23.738ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6022024-12-21T07:47:23.738ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00a6dd72-37ba-4ba2-ab72-455480e1785b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6032024-12-21T07:47:23.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6042024-12-21T07:47:23.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6052024-12-21T07:47:23.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6062024-12-21T07:47:23.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6072024-12-21T07:47:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6082024-12-21T07:47:23.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6092024-12-21T07:47:23.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6102024-12-21T07:47:23.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6112024-12-21T07:47:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6122024-12-21T07:47:23.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 170.614247ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6132024-12-21T07:47:23.750ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-12-21T07:47:23.751ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6152024-12-21T07:47:23.751ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 175.767754ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6162024-12-21T07:47:23.755ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6172024-12-21T07:47:23.755ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6182024-12-21T07:47:23.755ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 178.953449ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6192024-12-21T07:47:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6202024-12-21T07:47:23.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6212024-12-21T07:47:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6222024-12-21T07:47:23.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232024-12-21T07:47:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6242024-12-21T07:47:23.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6252024-12-21T07:47:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6262024-12-21T07:47:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 188.665776ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
6272024-12-21T07:47:23.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6282024-12-21T07:47:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6292024-12-21T07:47:23.767ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.335172ms iteration = 1 status = {}
6302024-12-21T07:47:23.770ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6312024-12-21T07:47:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6322024-12-21T07:47:23.778ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6332024-12-21T07:47:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6342024-12-21T07:47:23.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352024-12-21T07:47:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6362024-12-21T07:47:23.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6372024-12-21T07:47:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6382024-12-21T07:47:23.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392024-12-21T07:47:23.789ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6402024-12-21T07:47:23.789ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6412024-12-21T07:47:23.789ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 213.659314ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6422024-12-21T07:47:23.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6432024-12-21T07:47:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6442024-12-21T07:47:23.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6452024-12-21T07:47:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6462024-12-21T07:47:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6472024-12-21T07:47:23.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482024-12-21T07:47:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6492024-12-21T07:47:23.804ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6502024-12-21T07:47:23.804ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a90dae92-193a-422d-b06f-2d1d62f4f7fb", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6512024-12-21T07:47:23.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6522024-12-21T07:47:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6532024-12-21T07:47:23.807ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6542024-12-21T07:47:23.807ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6552024-12-21T07:47:23.807ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6562024-12-21T07:47:23.810ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "25b20435-03c7-4bcc-a465-46cc280c9e13", "content-length": "476", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6572024-12-21T07:47:23.811ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 235.507739ms iteration = 1 status = null
6582024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6592024-12-21T07:47:23.814ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6602024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 238.782265ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6612024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14d0a21e-53be-4517-9d4a-ebbbc80e03a5", "content-length": "734", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6622024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6632024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "57b6783c-db41-40ea-9ac8-e96963fc4f27", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6642024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6652024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "235c69f1-94c8-4d25-8468-4dfdb10c57cf", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6662024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6672024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "81afdca2-0dfb-472d-bbbb-921f0392074d", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6682024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6692024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b5b683b-9600-412c-a50a-63da06ef01e3", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6702024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6712024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a73d5d-abf2-4213-a941-5a63e7ee8649", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6722024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6732024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "32098514-58ff-405c-a16a-18b439594d86", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6742024-12-21T07:47:23.820ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6752024-12-21T07:47:23.820ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b136977-1fb5-4a3d-a4fa-e738174bea57", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6762024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6772024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "088cd837-eedd-428a-ae97-104450e95dc1", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6782024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6792024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e5c3e6d-0de7-4d10-bff4-ab2f9f12dd24", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6802024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6812024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d09c391-a678-4556-b737-d77296a5a8f5", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6822024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6832024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "70ff7181-9996-469f-89a8-b43d057788cf", "content-length": "722", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6842024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6852024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28ec4c36-2c94-42d9-bdf8-bf1da8b6c5a4", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6862024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6872024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f196b678-31ba-44c4-a29d-e121114d5271", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6882024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6892024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9dbf037-8b98-4f30-b94f-eeabdb088469", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6902024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6912024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "01811ff5-8b99-447b-9edb-ec964d428c6f", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6922024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6932024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e307133-1e08-47e4-9de4-8e8f52b4b0b4", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6942024-12-21T07:47:23.823ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6952024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21a92df5-2c3b-4972-82d6-c34ecd02fce2", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6962024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6972024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "39148b06-606f-434e-99c7-1c3f0e441841", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6982024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6992024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5097355e-5dba-4691-95bf-77573d87c29e", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7002024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7012024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "32dadab7-adca-46ec-a06e-72c134bbc2aa", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7022024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7032024-12-21T07:47:23.825ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f6f2ca-6014-47d0-8427-dc55686330ee", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7042024-12-21T07:47:23.825ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7052024-12-21T07:47:23.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 249.109952ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7062024-12-21T07:47:23.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7072024-12-21T07:47:23.827ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7082024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7092024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7102024-12-21T07:47:23.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7112024-12-21T07:47:23.828ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
7122024-12-21T07:47:23.828ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 252.831506ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
7132024-12-21T07:47:23.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142024-12-21T07:47:23.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7152024-12-21T07:47:23.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7162024-12-21T07:47:23.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7172024-12-21T07:47:23.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7182024-12-21T07:47:23.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 262.009914ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7192024-12-21T07:47:23.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7202024-12-21T07:47:23.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 269.458042ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7212024-12-21T07:47:23.851ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
7222024-12-21T07:47:23.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 276.084744ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
7232024-12-21T07:47:23.855ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7242024-12-21T07:47:23.855ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 278.972494ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7252024-12-21T07:47:23.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7262024-12-21T07:47:23.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7272024-12-21T07:47:23.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7282024-12-21T07:47:23.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7292024-12-21T07:47:23.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302024-12-21T07:47:23.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7312024-12-21T07:47:23.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-12-21T07:47:23.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-12-21T07:47:23.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7342024-12-21T07:47:23.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7352024-12-21T07:47:23.874ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7362024-12-21T07:47:23.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7372024-12-21T07:47:23.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7382024-12-21T07:47:23.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7392024-12-21T07:47:23.877ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7402024-12-21T07:47:23.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7412024-12-21T07:47:23.881ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-12-21T07:47:23.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7432024-12-21T07:47:23.885ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7442024-12-21T07:47:23.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7452024-12-21T07:47:23.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462024-12-21T07:47:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-12-21T07:47:23.921ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7482024-12-21T07:47:23.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7492024-12-21T07:47:23.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 345.786351ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7502024-12-21T07:47:23.955ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7512024-12-21T07:47:23.955ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7522024-12-21T07:47:23.956ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58465218-da24-4e03-9bc3-22494efa4e7a", "content-length": "312", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7532024-12-21T07:47:23.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542024-12-21T07:47:23.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552024-12-21T07:47:23.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-12-21T07:47:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7572024-12-21T07:47:23.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-12-21T07:47:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-12-21T07:47:23.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602024-12-21T07:47:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612024-12-21T07:47:23.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-12-21T07:47:23.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-12-21T07:47:23.974ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7642024-12-21T07:47:23.974ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 398.031387ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7652024-12-21T07:47:23.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-12-21T07:47:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-12-21T07:47:23.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-12-21T07:47:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692024-12-21T07:47:23.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-12-21T07:47:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-12-21T07:47:23.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-12-21T07:47:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-12-21T07:47:23.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-12-21T07:47:23.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7752024-12-21T07:47:23.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762024-12-21T07:47:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772024-12-21T07:47:23.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782024-12-21T07:47:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792024-12-21T07:47:23.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-12-21T07:47:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-12-21T07:47:24.007ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
7822024-12-21T07:47:24.007ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
7832024-12-21T07:47:24.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7842024-12-21T07:47:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7852024-12-21T07:47:24.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7862024-12-21T07:47:24.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872024-12-21T07:47:24.017ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7882024-12-21T07:47:24.017ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7892024-12-21T07:47:24.018ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "77449fe2-223b-489f-ac02-38189e06e373", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7902024-12-21T07:47:24.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7912024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7922024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7932024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7942024-12-21T07:47:24.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7952024-12-21T07:47:24.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7962024-12-21T07:47:24.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972024-12-21T07:47:24.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982024-12-21T07:47:24.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7992024-12-21T07:47:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8002024-12-21T07:47:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012024-12-21T07:47:24.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022024-12-21T07:47:24.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8032024-12-21T07:47:24.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8042024-12-21T07:47:24.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052024-12-21T07:47:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062024-12-21T07:47:24.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072024-12-21T07:47:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082024-12-21T07:47:24.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092024-12-21T07:47:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8102024-12-21T07:47:24.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8112024-12-21T07:47:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8122024-12-21T07:47:24.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8132024-12-21T07:47:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8142024-12-21T07:47:24.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8152024-12-21T07:47:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8162024-12-21T07:47:24.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172024-12-21T07:47:24.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8182024-12-21T07:47:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8192024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8202024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8212024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8222024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8232024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8242024-12-21T07:47:24.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8252024-12-21T07:47:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8262024-12-21T07:47:24.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8272024-12-21T07:47:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8282024-12-21T07:47:24.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8292024-12-21T07:47:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8302024-12-21T07:47:24.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8312024-12-21T07:47:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8322024-12-21T07:47:24.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8332024-12-21T07:47:24.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8342024-12-21T07:47:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8352024-12-21T07:47:24.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8362024-12-21T07:47:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8372024-12-21T07:47:24.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8382024-12-21T07:47:24.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8392024-12-21T07:47:24.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8402024-12-21T07:47:24.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8412024-12-21T07:47:24.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8422024-12-21T07:47:24.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432024-12-21T07:47:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8442024-12-21T07:47:24.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8452024-12-21T07:47:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8462024-12-21T07:47:24.064ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8472024-12-21T07:47:24.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8482024-12-21T07:47:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8492024-12-21T07:47:24.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8502024-12-21T07:47:24.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8512024-12-21T07:47:24.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8522024-12-21T07:47:24.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8532024-12-21T07:47:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8542024-12-21T07:47:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8552024-12-21T07:47:24.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8562024-12-21T07:47:24.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8572024-12-21T07:47:24.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8582024-12-21T07:47:24.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8592024-12-21T07:47:24.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8602024-12-21T07:47:24.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8612024-12-21T07:47:24.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622024-12-21T07:47:24.109ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8632024-12-21T07:47:24.109ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8642024-12-21T07:47:24.109ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8652024-12-21T07:47:24.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8662024-12-21T07:47:24.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-12-21T07:47:24.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-12-21T07:47:24.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692024-12-21T07:47:24.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702024-12-21T07:47:24.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712024-12-21T07:47:24.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722024-12-21T07:47:24.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8732024-12-21T07:47:24.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8742024-12-21T07:47:24.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8752024-12-21T07:47:24.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8762024-12-21T07:47:24.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8772024-12-21T07:47:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8782024-12-21T07:47:24.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8792024-12-21T07:47:24.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8802024-12-21T07:47:24.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8812024-12-21T07:47:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8822024-12-21T07:47:24.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8832024-12-21T07:47:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8842024-12-21T07:47:24.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8852024-12-21T07:47:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8862024-12-21T07:47:24.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8872024-12-21T07:47:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8882024-12-21T07:47:24.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8892024-12-21T07:47:24.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8902024-12-21T07:47:24.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8912024-12-21T07:47:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8922024-12-21T07:47:24.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8932024-12-21T07:47:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8942024-12-21T07:47:24.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8952024-12-21T07:47:24.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8962024-12-21T07:47:24.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8972024-12-21T07:47:24.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8982024-12-21T07:47:24.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-12-21T07:47:24.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9002024-12-21T07:47:24.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9012024-12-21T07:47:24.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9022024-12-21T07:47:24.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9032024-12-21T07:47:24.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9042024-12-21T07:47:24.181ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9052024-12-21T07:47:24.182ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9294598-d2ad-43bc-bec3-39a39f9e836c", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:24 GMT"} })
9062024-12-21T07:47:24.182ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9072024-12-21T07:47:24.182ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9082024-12-21T07:47:24.182ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9092024-12-21T07:47:24.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9102024-12-21T07:47:24.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9112024-12-21T07:47:24.183ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 607.261395ms iteration = 1 status = {}
9122024-12-21T07:47:24.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9132024-12-21T07:47:24.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142024-12-21T07:47:24.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-12-21T07:47:24.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162024-12-21T07:47:24.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9172024-12-21T07:47:24.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9182024-12-21T07:47:24.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192024-12-21T07:47:24.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202024-12-21T07:47:24.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212024-12-21T07:47:24.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
9222024-12-21T07:47:24.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232024-12-21T07:47:24.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9242024-12-21T07:47:24.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9252024-12-21T07:47:24.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9262024-12-21T07:47:24.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9272024-12-21T07:47:24.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9282024-12-21T07:47:24.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9292024-12-21T07:47:24.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9302024-12-21T07:47:24.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9312024-12-21T07:47:24.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9322024-12-21T07:47:24.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9332024-12-21T07:47:24.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9342024-12-21T07:47:24.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2bf4a0e2-c632-4fe9-a2c3-85a42f7994c7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
9352024-12-21T07:47:24.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2bf4a0e2-c632-4fe9-a2c3-85a42f7994c7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
9362024-12-21T07:47:24.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372024-12-21T07:47:24.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9382024-12-21T07:47:24.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2bf4a0e2-c632-4fe9-a2c3-85a42f7994c7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
9392024-12-21T07:47:24.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402024-12-21T07:47:24.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
9412024-12-21T07:47:24.278ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
9422024-12-21T07:47:24.278ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9432024-12-21T07:47:24.278ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9442024-12-21T07:47:24.278ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 699.982436ms
9452024-12-21T07:47:24.278ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 702.715883ms iteration = 1 status = {}
9462024-12-21T07:47:24.278ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9472024-12-21T07:47:24.298ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "312a4968-bfb4-4f8b-889c-44a4e3fdcc2a", "date": "Sat, 21 Dec 2024 07:47:24 GMT"} })
9482024-12-21T07:47:24.299ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 722.808087ms iteration = 1 status = {}
9492024-12-21T07:47:24.453ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bfa2489-4a78-42fa-a323-cf8b4151d9e1", "content-length": "30784", "date": "Sat, 21 Dec 2024 07:47:24 GMT"} })
9502024-12-21T07:47:24.455ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9512024-12-21T07:47:24.455ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9522024-12-21T07:47:24.455ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9532024-12-21T07:47:24.457ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9542024-12-21T07:47:24.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9552024-12-21T07:47:24.459ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9562024-12-21T07:47:24.460ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9572024-12-21T07:47:24.461ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9582024-12-21T07:47:24.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9592024-12-21T07:47:24.684ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9602024-12-21T07:47:24.684ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9612024-12-21T07:47:24.689ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9622024-12-21T07:47:24.689ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9632024-12-21T07:47:24.718ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642024-12-21T07:47:24.721ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5b228607-94ff-4bfc-99d8-b10385e90443, lookup_type: ById(5b228607-94ff-4bfc-99d8-b10385e90443) } result = Ok(())
9652024-12-21T07:47:24.721ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5b228607-94ff-4bfc-99d8-b10385e90443, time_created: 2024-12-21T07:47:23.391125Z, time_modified: 2024-12-21T07:47:23.391125Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9662024-12-21T07:47:24.998ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 32aca71e-b39b-47ab-a2c7-b9f0a55c8abc file = nexus/db-queries/src/db/datastore/inventory.rs:1010
9672024-12-21T07:47:24.998ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 32aca71e-b39b-47ab-a2c7-b9f0a55c8abc time_started = 2024-12-21 07:47:23.799551 UTC
9682024-12-21T07:47:24.998ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.424034934s iteration = 1 status = {"collection_id":"32aca71e-b39b-47ab-a2c7-b9f0a55c8abc","time_done":"2024-12-21 07:47:24.455720 UTC","time_started":"2024-12-21 07:47:23.799551 UTC"}
9692024-12-21T07:47:24.998ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
9702024-12-21T07:47:24.998ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9712024-12-21T07:47:24.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9722024-12-21T07:47:24.999ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
9732024-12-21T07:47:24.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9742024-12-21T07:47:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9752024-12-21T07:47:25.000ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-12-21T07:47:25.002ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9772024-12-21T07:47:25.002ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9782024-12-21T07:47:25.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9792024-12-21T07:47:25.028ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(6b1a85ac-7e74-4f33-a8e4-8fdc94ea2812, 0), (61de7a61-ac32-4049-9cbe-3673f32e1c5d, 0), (32aca71e-b39b-47ab-a2c7-b9f0a55c8abc, 0)]
9802024-12-21T07:47:25.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 983768399 } })
9812024-12-21T07:47:25.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822024-12-21T07:47:25.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9832024-12-21T07:47:25.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9842024-12-21T07:47:25.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9852024-12-21T07:47:25.033ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
9862024-12-21T07:47:25.033ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 34.813677ms iteration = 2 status = {"error":"rack not yet initialized: 5b228607-94ff-4bfc-99d8-b10385e90443"}
9872024-12-21T07:47:25.060ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9882024-12-21T07:47:25.060ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9892024-12-21T07:47:25.060ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9902024-12-21T07:47:25.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "752e03e7-dc4a-4f76-aafc-ca83ee663d74", "content-length": "476", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
9912024-12-21T07:47:25.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9922024-12-21T07:47:25.061ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c846e0f-38c7-4fd3-b024-6e39100c1ff1", "content-length": "734", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
9932024-12-21T07:47:25.061ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9942024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e722626-24ed-4a93-ad50-f16b27d4214b", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
9952024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
9962024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e761250a-c639-4575-94fd-134d52fd2331", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
9972024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
9982024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6125155-f2f8-44f0-a3de-7ff4ac5dd440", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
9992024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10002024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2725fad-86a0-4673-b0d4-14357513cdb0", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10012024-12-21T07:47:25.062ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10022024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b10138b-eb45-4a13-b936-9a6a5ef34326", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10032024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10042024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1714821c-5cde-4274-9cd9-3c1fc44ac40d", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10052024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
10062024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1693bb72-f674-40cd-863b-4cd0f6051ffc", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10072024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10082024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9797bf3-0035-4380-a65c-b95a59aa7f84", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10092024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10102024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a07dc7e6-2846-4432-96df-4178313ec36d", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10112024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10122024-12-21T07:47:25.063ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e19418fd-eb12-496e-9dc3-703cd41d8c78", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10132024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
10142024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36a92682-94e4-4421-8f2f-d3f8928e05fb", "content-length": "722", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10152024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
10162024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bff94e7-7489-461f-b473-16b7a553352e", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10172024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
10182024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f396b25-4f6a-4a6f-b198-c93f571d3e9c", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10192024-12-21T07:47:25.064ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
10202024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64aa5443-1b2e-4ca4-aa0b-d2d3314f0be1", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10212024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
10222024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "af7a2d61-1604-4826-bb37-ba8a2e5d9a5d", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10232024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
10242024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2605bc8d-bed3-4965-ad34-5a223ab257bf", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10252024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
10262024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7ea2887-fdfc-474d-a79e-127eea4c81a0", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10272024-12-21T07:47:25.065ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
10282024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b274fb0d-51f3-4587-a1bf-b5a09c3b3dd6", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10292024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10302024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "00709af2-8fe0-4752-9cac-b6ac59d0d440", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10312024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10322024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70d1a904-f762-4061-9730-41e6ab1d099d", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10332024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10342024-12-21T07:47:25.066ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "881bc61a-91bd-4848-9fb9-a92b4393cf36", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10352024-12-21T07:47:25.067ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10362024-12-21T07:47:25.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10372024-12-21T07:47:25.068ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382024-12-21T07:47:25.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10392024-12-21T07:47:25.070ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10402024-12-21T07:47:25.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10412024-12-21T07:47:25.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-12-21T07:47:25.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10432024-12-21T07:47:25.074ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10442024-12-21T07:47:25.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10452024-12-21T07:47:25.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e38c59f5-b08d-4067-984a-ecd6bf50127b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10462024-12-21T07:47:25.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e38c59f5-b08d-4067-984a-ecd6bf50127b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10472024-12-21T07:47:25.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e38c59f5-b08d-4067-984a-ecd6bf50127b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10482024-12-21T07:47:25.407ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10492024-12-21T07:47:25.407ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10502024-12-21T07:47:25.616ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a67649d6-9094-4876-b1be-dbae2802e91a", "content-length": "30785", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
10512024-12-21T07:47:25.618ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10522024-12-21T07:47:25.618ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10532024-12-21T07:47:25.618ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10542024-12-21T07:47:25.619ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10552024-12-21T07:47:25.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10562024-12-21T07:47:25.621ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572024-12-21T07:47:25.623ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10582024-12-21T07:47:25.623ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10592024-12-21T07:47:25.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10602024-12-21T07:47:25.662ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e file = nexus/db-queries/src/db/datastore/inventory.rs:1010
10612024-12-21T07:47:25.662ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e time_started = 2024-12-21 07:47:25.060256 UTC
10622024-12-21T07:47:25.662ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 663.721075ms iteration = 2 status = {"collection_id":"5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e","time_done":"2024-12-21 07:47:25.618036 UTC","time_started":"2024-12-21 07:47:25.060256 UTC"}
10632024-12-21T07:47:25.662ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
10642024-12-21T07:47:25.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10652024-12-21T07:47:25.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10662024-12-21T07:47:25.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10672024-12-21T07:47:25.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10682024-12-21T07:47:25.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10692024-12-21T07:47:25.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10702024-12-21T07:47:25.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10712024-12-21T07:47:25.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10722024-12-21T07:47:25.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-12-21T07:47:25.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10742024-12-21T07:47:25.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10752024-12-21T07:47:25.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10762024-12-21T07:47:25.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.021855ms iteration = 3 status = {"physical_disks_added":0}
10772024-12-21T07:47:26.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 94cd4f81-71af-4be7-b3b2-6fbd72db7e56 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10782024-12-21T07:47:26.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 94cd4f81-71af-4be7-b3b2-6fbd72db7e56 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10792024-12-21T07:47:26.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 94cd4f81-71af-4be7-b3b2-6fbd72db7e56 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
10802024-12-21T07:47:26.721ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10812024-12-21T07:47:26.722ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10822024-12-21T07:47:26.724ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10832024-12-21T07:47:26.724ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10842024-12-21T07:47:26.725ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-12-21T07:47:26.728ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5b228607-94ff-4bfc-99d8-b10385e90443, lookup_type: ById(5b228607-94ff-4bfc-99d8-b10385e90443) } result = Ok(())
10862024-12-21T07:47:26.728ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
10872024-12-21T07:47:26.728ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10882024-12-21T07:47:26.728ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10892024-12-21T07:47:26.730ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10902024-12-21T07:47:26.730ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10912024-12-21T07:47:26.732ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10922024-12-21T07:47:26.732ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10932024-12-21T07:47:26.733ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10942024-12-21T07:47:26.733ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10952024-12-21T07:47:26.735ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10962024-12-21T07:47:26.735ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10972024-12-21T07:47:26.737ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10982024-12-21T07:47:26.737ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10992024-12-21T07:47:26.738ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-12-21T07:47:26.741ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11012024-12-21T07:47:26.741ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11022024-12-21T07:47:26.741ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11032024-12-21T07:47:26.742ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11042024-12-21T07:47:26.743ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11052024-12-21T07:47:26.744ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11062024-12-21T07:47:26.744ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11072024-12-21T07:47:26.745ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082024-12-21T07:47:26.748ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11092024-12-21T07:47:26.748ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11102024-12-21T07:47:26.748ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11112024-12-21T07:47:26.750ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11122024-12-21T07:47:26.751ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11132024-12-21T07:47:26.752ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11142024-12-21T07:47:26.752ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11152024-12-21T07:47:26.753ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11162024-12-21T07:47:26.753ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11172024-12-21T07:47:26.754ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11182024-12-21T07:47:26.755ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11192024-12-21T07:47:26.756ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11202024-12-21T07:47:26.756ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11212024-12-21T07:47:26.757ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11222024-12-21T07:47:26.757ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11232024-12-21T07:47:26.759ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-12-21T07:47:26.761ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11252024-12-21T07:47:26.761ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11262024-12-21T07:47:26.762ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11272024-12-21T07:47:26.763ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11282024-12-21T07:47:26.763ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11292024-12-21T07:47:26.764ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11302024-12-21T07:47:26.764ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11312024-12-21T07:47:26.766ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11322024-12-21T07:47:26.766ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11332024-12-21T07:47:26.768ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11342024-12-21T07:47:26.768ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11352024-12-21T07:47:26.769ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11362024-12-21T07:47:26.770ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11372024-12-21T07:47:26.771ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11382024-12-21T07:47:26.771ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11392024-12-21T07:47:26.772ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-12-21T07:47:26.775ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11412024-12-21T07:47:26.775ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11422024-12-21T07:47:26.775ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11432024-12-21T07:47:26.776ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11442024-12-21T07:47:26.776ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11452024-12-21T07:47:26.777ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11462024-12-21T07:47:26.777ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11472024-12-21T07:47:26.779ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11482024-12-21T07:47:26.782ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11492024-12-21T07:47:26.782ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11502024-12-21T07:47:26.782ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11512024-12-21T07:47:26.788ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11522024-12-21T07:47:26.788ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11532024-12-21T07:47:26.789ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11542024-12-21T07:47:26.789ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11552024-12-21T07:47:26.790ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11562024-12-21T07:47:26.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11572024-12-21T07:47:26.792ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11582024-12-21T07:47:26.792ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11592024-12-21T07:47:26.794ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11602024-12-21T07:47:26.794ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11612024-12-21T07:47:26.796ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11622024-12-21T07:47:26.796ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11632024-12-21T07:47:26.797ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11642024-12-21T07:47:26.797ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11652024-12-21T07:47:26.798ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-12-21T07:47:26.801ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11672024-12-21T07:47:26.801ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11682024-12-21T07:47:26.801ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11692024-12-21T07:47:26.802ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11702024-12-21T07:47:26.802ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11712024-12-21T07:47:26.803ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11722024-12-21T07:47:26.804ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11732024-12-21T07:47:26.805ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11742024-12-21T07:47:26.808ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11752024-12-21T07:47:26.808ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11762024-12-21T07:47:26.808ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11772024-12-21T07:47:26.820ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
11782024-12-21T07:47:26.820ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11792024-12-21T07:47:26.820ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11802024-12-21T07:47:26.821ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-12-21T07:47:26.823ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
11822024-12-21T07:47:26.823ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11832024-12-21T07:47:26.823ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11842024-12-21T07:47:26.830ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
11852024-12-21T07:47:26.835ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
11862024-12-21T07:47:26.835ZDEBGnexus (InternalApi): resolved 2 rules for sleds
11872024-12-21T07:47:26.911ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
11882024-12-21T07:47:26.911ZDEBGnexus (InternalApi): sending firewall rules to sled agents
11892024-12-21T07:47:26.911ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11902024-12-21T07:47:26.912ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11912024-12-21T07:47:26.914ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11922024-12-21T07:47:26.914ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11932024-12-21T07:47:26.915ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-12-21T07:47:26.918ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
11952024-12-21T07:47:26.951ZDEBGnexus (InternalApi): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
11962024-12-21T07:47:26.952ZDEBGnexus (InternalApi): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f1cb0fa8-e56c-4b43-90d9-335e5fd26932", "date": "Sat, 21 Dec 2024 07:47:26 GMT"} })
11972024-12-21T07:47:26.953ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
11982024-12-21T07:47:26.953ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
11992024-12-21T07:47:27.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 91496833-f516-4b3b-be28-922cf237b20f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12002024-12-21T07:47:27.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 91496833-f516-4b3b-be28-922cf237b20f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12012024-12-21T07:47:27.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 91496833-f516-4b3b-be28-922cf237b20f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12022024-12-21T07:47:28.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdb56cfe-f769-4f1c-9920-0f2224f52aca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12032024-12-21T07:47:28.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdb56cfe-f769-4f1c-9920-0f2224f52aca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12042024-12-21T07:47:28.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdb56cfe-f769-4f1c-9920-0f2224f52aca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12052024-12-21T07:47:29.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c585f19-3ffc-4910-835a-6a61f11e3a92 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12062024-12-21T07:47:29.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c585f19-3ffc-4910-835a-6a61f11e3a92 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12072024-12-21T07:47:29.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c585f19-3ffc-4910-835a-6a61f11e3a92 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12082024-12-21T07:47:30.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ad6533cd-6906-40a3-bfd0-5fb36c9a25ec roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12092024-12-21T07:47:30.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ad6533cd-6906-40a3-bfd0-5fb36c9a25ec resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12102024-12-21T07:47:30.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ad6533cd-6906-40a3-bfd0-5fb36c9a25ec response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12112024-12-21T07:47:31.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e81ba6b-917b-4a44-bf22-db1cd46721e2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12122024-12-21T07:47:31.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e81ba6b-917b-4a44-bf22-db1cd46721e2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12132024-12-21T07:47:31.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e81ba6b-917b-4a44-bf22-db1cd46721e2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12142024-12-21T07:47:32.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72e4ef54-5746-480b-a9e7-b4bfbb2a048e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12152024-12-21T07:47:32.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72e4ef54-5746-480b-a9e7-b4bfbb2a048e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12162024-12-21T07:47:32.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72e4ef54-5746-480b-a9e7-b4bfbb2a048e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12172024-12-21T07:47:33.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37ce4a58-b232-4c39-9182-b90be93c7ceb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12182024-12-21T07:47:33.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37ce4a58-b232-4c39-9182-b90be93c7ceb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12192024-12-21T07:47:33.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37ce4a58-b232-4c39-9182-b90be93c7ceb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12202024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
12212024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12222024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
12232024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12242024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12252024-12-21T07:47:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12262024-12-21T07:47:33.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272024-12-21T07:47:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12282024-12-21T07:47:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292024-12-21T07:47:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302024-12-21T07:47:33.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12312024-12-21T07:47:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12322024-12-21T07:47:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12332024-12-21T07:47:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
12342024-12-21T07:47:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12352024-12-21T07:47:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12362024-12-21T07:47:33.601ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
12372024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.480637ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z","time_found":"2024-12-21T07:47:33.601992041Z"}
12382024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
12392024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
12402024-12-21T07:47:33.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
12412024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.601\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
12422024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12432024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12442024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12452024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12462024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12472024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12482024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12492024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12502024-12-21T07:47:33.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12512024-12-21T07:47:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12522024-12-21T07:47:33.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12542024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12552024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12562024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12582024-12-21T07:47:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12592024-12-21T07:47:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12602024-12-21T07:47:33.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12612024-12-21T07:47:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12622024-12-21T07:47:33.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632024-12-21T07:47:33.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12642024-12-21T07:47:33.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12652024-12-21T07:47:33.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12662024-12-21T07:47:33.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-12-21T07:47:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12682024-12-21T07:47:33.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12692024-12-21T07:47:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12702024-12-21T07:47:33.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712024-12-21T07:47:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12722024-12-21T07:47:33.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12732024-12-21T07:47:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12742024-12-21T07:47:33.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.342032ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12752024-12-21T07:47:33.650ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12762024-12-21T07:47:33.684ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
12772024-12-21T07:47:33.716ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
12782024-12-21T07:47:33.748ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
12792024-12-21T07:47:33.786ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
12802024-12-21T07:47:34.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d08b8be6-2b27-470e-ad68-6c465825260e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12812024-12-21T07:47:34.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d08b8be6-2b27-470e-ad68-6c465825260e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12822024-12-21T07:47:34.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d08b8be6-2b27-470e-ad68-6c465825260e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
12832024-12-21T07:47:34.664ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a403363a-f540-492d-a5b6-94d5a64dcdd3", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
12842024-12-21T07:47:34.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12852024-12-21T07:47:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12862024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e910015e-36a2-4d4b-b309-91efde68ca4b", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
12872024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12882024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12892024-12-21T07:47:34.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12912024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12922024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12932024-12-21T07:47:34.694ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942024-12-21T07:47:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12952024-12-21T07:47:34.695ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12962024-12-21T07:47:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12972024-12-21T07:47:34.704ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3bfe06-dd0f-44ba-aa19-e05fba97850f", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
12982024-12-21T07:47:34.704ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12992024-12-21T07:47:34.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13002024-12-21T07:47:34.706ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-12-21T07:47:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13022024-12-21T07:47:34.707ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13032024-12-21T07:47:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13042024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4522d95c-833e-43d3-9d1c-ccd790ebd08d", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:34 GMT"} })
13052024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13062024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13072024-12-21T07:47:34.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13092024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13102024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13112024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b56749-2ced-450d-b1f5-d74765402bbc", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:34 GMT"} })
13122024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13132024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13142024-12-21T07:47:34.786ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-12-21T07:47:34.787ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13162024-12-21T07:47:34.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13172024-12-21T07:47:34.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13182024-12-21T07:47:34.793ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.191478226s iteration = 2 status = {"nsuccess":5}
13192024-12-21T07:47:35.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d8025ea7-173a-481b-9854-8ed4fe26dae8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13202024-12-21T07:47:35.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d8025ea7-173a-481b-9854-8ed4fe26dae8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13212024-12-21T07:47:35.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d8025ea7-173a-481b-9854-8ed4fe26dae8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13222024-12-21T07:47:35.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 4e19b04e-fc99-4312-946d-694daa6cd61f roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
13232024-12-21T07:47:35.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 4e19b04e-fc99-4312-946d-694daa6cd61f resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
13242024-12-21T07:47:35.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 4e19b04e-fc99-4312-946d-694daa6cd61f response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
13252024-12-21T07:47:35.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 94033238-a6ea-4ee5-b6d0-64390720708f roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmU2MTgwZi0yODk2LTQ1OTItYjE1NS1mNWNhM2Y5MDRmYTcifX0%3D
13262024-12-21T07:47:35.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 94033238-a6ea-4ee5-b6d0-64390720708f resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmU2MTgwZi0yODk2LTQ1OTItYjE1NS1mNWNhM2Y5MDRmYTcifX0%3D
13272024-12-21T07:47:35.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 94033238-a6ea-4ee5-b6d0-64390720708f response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmU2MTgwZi0yODk2LTQ1OTItYjE1NS1mNWNhM2Y5MDRmYTcifX0%3D
13282024-12-21T07:47:36.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7ad02ab-823e-46a1-ab22-30c1f22700a8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13292024-12-21T07:47:36.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7ad02ab-823e-46a1-ab22-30c1f22700a8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13302024-12-21T07:47:36.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7ad02ab-823e-46a1-ab22-30c1f22700a8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13312024-12-21T07:47:37.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5cf1989-76f9-45ac-86c4-f7a85419e476 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13322024-12-21T07:47:37.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5cf1989-76f9-45ac-86c4-f7a85419e476 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13332024-12-21T07:47:37.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5cf1989-76f9-45ac-86c4-f7a85419e476 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13342024-12-21T07:47:38.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9379d883-edd4-4c91-9a15-2f47b1696f07 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13352024-12-21T07:47:38.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9379d883-edd4-4c91-9a15-2f47b1696f07 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13362024-12-21T07:47:38.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9379d883-edd4-4c91-9a15-2f47b1696f07 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13372024-12-21T07:47:39.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb5b3cc-b943-4a5f-be3e-e85efd57f89d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13382024-12-21T07:47:39.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb5b3cc-b943-4a5f-be3e-e85efd57f89d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13392024-12-21T07:47:39.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb5b3cc-b943-4a5f-be3e-e85efd57f89d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13402024-12-21T07:47:40.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd72e8-81d4-4587-b4da-7cb845543f42 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13412024-12-21T07:47:40.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd72e8-81d4-4587-b4da-7cb845543f42 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13422024-12-21T07:47:40.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd72e8-81d4-4587-b4da-7cb845543f42 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13432024-12-21T07:47:41.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c43eafb-0bdb-4950-9f1f-c8d0a7e97cd5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13442024-12-21T07:47:41.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c43eafb-0bdb-4950-9f1f-c8d0a7e97cd5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13452024-12-21T07:47:41.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c43eafb-0bdb-4950-9f1f-c8d0a7e97cd5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13462024-12-21T07:47:42.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b963ed3e-42dd-423f-aa06-372596227b78 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13472024-12-21T07:47:42.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b963ed3e-42dd-423f-aa06-372596227b78 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13482024-12-21T07:47:42.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b963ed3e-42dd-423f-aa06-372596227b78 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13492024-12-21T07:47:43.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
13502024-12-21T07:47:43.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13512024-12-21T07:47:43.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
13522024-12-21T07:47:43.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13532024-12-21T07:47:43.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13542024-12-21T07:47:43.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552024-12-21T07:47:43.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562024-12-21T07:47:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13572024-12-21T07:47:43.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13582024-12-21T07:47:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13592024-12-21T07:47:43.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13602024-12-21T07:47:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13612024-12-21T07:47:43.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13622024-12-21T07:47:43.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13632024-12-21T07:47:43.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.802283ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13642024-12-21T07:47:43.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652024-12-21T07:47:43.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
13662024-12-21T07:47:43.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13672024-12-21T07:47:43.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13682024-12-21T07:47:43.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
13692024-12-21T07:47:43.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.659668ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
13702024-12-21T07:47:43.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1f557fb9-0eed-4cd2-b678-50a9a598da0d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13712024-12-21T07:47:43.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1f557fb9-0eed-4cd2-b678-50a9a598da0d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13722024-12-21T07:47:43.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1f557fb9-0eed-4cd2-b678-50a9a598da0d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13732024-12-21T07:47:44.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 110cc7b2-292c-4ffe-9805-39386ea438ac roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13742024-12-21T07:47:44.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 110cc7b2-292c-4ffe-9805-39386ea438ac resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13752024-12-21T07:47:44.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 110cc7b2-292c-4ffe-9805-39386ea438ac response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13762024-12-21T07:47:45.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bc07950-54b3-4dbd-ba21-012ab31b6f83 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13772024-12-21T07:47:45.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bc07950-54b3-4dbd-ba21-012ab31b6f83 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13782024-12-21T07:47:45.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bc07950-54b3-4dbd-ba21-012ab31b6f83 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13792024-12-21T07:47:46.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dc440ec0-a3c2-4d58-a4cb-9d0b1f08dac2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13802024-12-21T07:47:46.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dc440ec0-a3c2-4d58-a4cb-9d0b1f08dac2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13812024-12-21T07:47:46.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dc440ec0-a3c2-4d58-a4cb-9d0b1f08dac2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13822024-12-21T07:47:47.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d685cf4d-3524-45ed-931c-e4f2b368e33e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13832024-12-21T07:47:47.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d685cf4d-3524-45ed-931c-e4f2b368e33e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13842024-12-21T07:47:47.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d685cf4d-3524-45ed-931c-e4f2b368e33e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13852024-12-21T07:47:48.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ab3619d-e315-4552-9a1c-cb3ea99ea79f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13862024-12-21T07:47:48.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ab3619d-e315-4552-9a1c-cb3ea99ea79f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13872024-12-21T07:47:48.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ab3619d-e315-4552-9a1c-cb3ea99ea79f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13882024-12-21T07:47:49.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4323468f-f85f-4d89-8ad0-816144205208 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13892024-12-21T07:47:49.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4323468f-f85f-4d89-8ad0-816144205208 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13902024-12-21T07:47:49.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4323468f-f85f-4d89-8ad0-816144205208 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13912024-12-21T07:47:50.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6ccd4b26-02b1-41ef-8926-2550a8f934da roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13922024-12-21T07:47:50.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6ccd4b26-02b1-41ef-8926-2550a8f934da resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13932024-12-21T07:47:50.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6ccd4b26-02b1-41ef-8926-2550a8f934da response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13942024-12-21T07:47:51.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e556f5e6-17fe-4427-aeba-b6ad10a0aaa0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13952024-12-21T07:47:51.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e556f5e6-17fe-4427-aeba-b6ad10a0aaa0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13962024-12-21T07:47:51.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e556f5e6-17fe-4427-aeba-b6ad10a0aaa0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13972024-12-21T07:47:52.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b34930b-dfa3-45a1-83dc-e6f182ad9ee7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13982024-12-21T07:47:52.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b34930b-dfa3-45a1-83dc-e6f182ad9ee7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
13992024-12-21T07:47:52.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b34930b-dfa3-45a1-83dc-e6f182ad9ee7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
14002024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
14012024-12-21T07:47:53.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14022024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
14032024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14042024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14052024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
14062024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
14072024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14082024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
14102024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14112024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
14122024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
14132024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14142024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14152024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
14162024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14172024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
14182024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14192024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
14202024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14212024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
14222024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
14232024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14242024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
14252024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14262024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
14272024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
14282024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14292024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14302024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
14312024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14322024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
14332024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14342024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14352024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14362024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14372024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14382024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14392024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14402024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14412024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14422024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14432024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14442024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14462024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14472024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14482024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14492024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14502024-12-21T07:47:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14512024-12-21T07:47:53.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14522024-12-21T07:47:53.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14532024-12-21T07:47:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14542024-12-21T07:47:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14552024-12-21T07:47:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.14978ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14562024-12-21T07:47:53.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572024-12-21T07:47:53.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582024-12-21T07:47:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14592024-12-21T07:47:53.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14602024-12-21T07:47:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14612024-12-21T07:47:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14622024-12-21T07:47:53.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14632024-12-21T07:47:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14642024-12-21T07:47:53.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 550134279 } })
14652024-12-21T07:47:53.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14662024-12-21T07:47:53.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14672024-12-21T07:47:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14682024-12-21T07:47:53.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 553904944 } })
14692024-12-21T07:47:53.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14702024-12-21T07:47:53.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14712024-12-21T07:47:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14722024-12-21T07:47:53.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732024-12-21T07:47:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14742024-12-21T07:47:53.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14752024-12-21T07:47:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14762024-12-21T07:47:53.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14772024-12-21T07:47:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14782024-12-21T07:47:53.642ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 596966893 } })
14792024-12-21T07:47:53.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14802024-12-21T07:47:53.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14812024-12-21T07:47:53.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14822024-12-21T07:47:53.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-12-21T07:47:53.642ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
14842024-12-21T07:47:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14852024-12-21T07:47:53.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.148282ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
14862024-12-21T07:47:53.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872024-12-21T07:47:53.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14882024-12-21T07:47:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14892024-12-21T07:47:53.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14902024-12-21T07:47:53.645ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14912024-12-21T07:47:53.645ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.210977ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14922024-12-21T07:47:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14932024-12-21T07:47:53.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942024-12-21T07:47:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14952024-12-21T07:47:53.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14962024-12-21T07:47:53.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14972024-12-21T07:47:53.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14982024-12-21T07:47:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14992024-12-21T07:47:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15002024-12-21T07:47:53.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.062389ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
15012024-12-21T07:47:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15022024-12-21T07:47:53.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15032024-12-21T07:47:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15042024-12-21T07:47:53.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15052024-12-21T07:47:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15062024-12-21T07:47:53.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15072024-12-21T07:47:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15082024-12-21T07:47:53.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15092024-12-21T07:47:53.674ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15102024-12-21T07:47:53.674ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aef6c39-3cdb-4b2d-9669-eb29a2739735", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15112024-12-21T07:47:53.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15122024-12-21T07:47:53.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15132024-12-21T07:47:53.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15142024-12-21T07:47:53.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15152024-12-21T07:47:53.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15162024-12-21T07:47:53.688ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15172024-12-21T07:47:53.689ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2637d21d-de8b-4cdd-bba2-c733c4fe96b2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15182024-12-21T07:47:53.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15192024-12-21T07:47:53.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.054249ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15202024-12-21T07:47:53.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15212024-12-21T07:47:53.691ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15222024-12-21T07:47:53.691ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15232024-12-21T07:47:53.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15242024-12-21T07:47:53.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15252024-12-21T07:47:53.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.112189ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15262024-12-21T07:47:53.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15272024-12-21T07:47:53.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
15282024-12-21T07:47:53.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15292024-12-21T07:47:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15302024-12-21T07:47:53.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.861905ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15312024-12-21T07:47:53.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322024-12-21T07:47:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15332024-12-21T07:47:53.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15342024-12-21T07:47:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15352024-12-21T07:47:53.712ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
15362024-12-21T07:47:53.712ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 136.210126ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
15372024-12-21T07:47:53.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.201393ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15382024-12-21T07:47:53.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
15392024-12-21T07:47:53.739ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15402024-12-21T07:47:53.739ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6425249e-38b0-4238-8e50-2186963e9d4e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15412024-12-21T07:47:53.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15422024-12-21T07:47:53.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
15432024-12-21T07:47:53.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15442024-12-21T07:47:53.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15452024-12-21T07:47:53.749ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15462024-12-21T07:47:53.749ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15472024-12-21T07:47:53.749ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 173.287282ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15482024-12-21T07:47:53.768ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.724258ms iteration = 2 status = {}
15492024-12-21T07:47:53.785ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15502024-12-21T07:47:53.785ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "48c0eafe-00d9-4cc5-bc7c-3989cea1f9b3", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15512024-12-21T07:47:53.786ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15522024-12-21T07:47:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15532024-12-21T07:47:53.789ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.533651ms iteration = 2 status = null
15542024-12-21T07:47:53.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15552024-12-21T07:47:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15562024-12-21T07:47:53.809ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15572024-12-21T07:47:53.809ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15582024-12-21T07:47:53.810ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5744a4f-906b-43ce-adc8-5ac438f6e710", "content-length": "372", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15592024-12-21T07:47:53.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15602024-12-21T07:47:53.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15612024-12-21T07:47:53.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15622024-12-21T07:47:53.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15632024-12-21T07:47:53.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-12-21T07:47:53.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15652024-12-21T07:47:53.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15662024-12-21T07:47:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15672024-12-21T07:47:53.864ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15682024-12-21T07:47:53.864ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15692024-12-21T07:47:53.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15702024-12-21T07:47:53.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15712024-12-21T07:47:53.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15722024-12-21T07:47:53.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15732024-12-21T07:47:53.894ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
15742024-12-21T07:47:53.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15752024-12-21T07:47:53.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15762024-12-21T07:47:53.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772024-12-21T07:47:53.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782024-12-21T07:47:53.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
15792024-12-21T07:47:53.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15802024-12-21T07:47:53.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15812024-12-21T07:47:53.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15822024-12-21T07:47:53.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15832024-12-21T07:47:53.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15842024-12-21T07:47:53.900ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 324.468405ms iteration = 2 status = 0
15852024-12-21T07:47:53.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15862024-12-21T07:47:53.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "473975f1-872f-438b-a759-1f24724b5b00", "content-length": "134", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
15872024-12-21T07:47:53.913ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15882024-12-21T07:47:53.913ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
15892024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15902024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15912024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15922024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15932024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15942024-12-21T07:47:53.918ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15952024-12-21T07:47:53.919ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15962024-12-21T07:47:53.919ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15972024-12-21T07:47:53.919ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
15982024-12-21T07:47:53.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15992024-12-21T07:47:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16002024-12-21T07:47:53.921ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 345.223351ms iteration = 4 status = {"physical_disks_added":0}
16012024-12-21T07:47:53.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16022024-12-21T07:47:53.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c57714d9-d8df-41f7-9eac-0cfed46f2df0", "content-length": "2", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
16032024-12-21T07:47:53.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16042024-12-21T07:47:53.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b08bbc9-6636-4a4d-bbc0-e19355cd6ac9", "content-length": "52", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
16052024-12-21T07:47:53.924ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
16062024-12-21T07:47:53.926ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16072024-12-21T07:47:53.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 03f84681-ae8d-4098-b393-63a1ffba9caa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16082024-12-21T07:47:53.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 03f84681-ae8d-4098-b393-63a1ffba9caa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16092024-12-21T07:47:53.991ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "da8e78b5-f15c-4532-9a54-a1f220ba3306", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
16102024-12-21T07:47:53.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16112024-12-21T07:47:53.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16122024-12-21T07:47:53.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 03f84681-ae8d-4098-b393-63a1ffba9caa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16132024-12-21T07:47:53.993ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16142024-12-21T07:47:53.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16152024-12-21T07:47:53.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16162024-12-21T07:47:53.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16172024-12-21T07:47:53.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16182024-12-21T07:47:54.000ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a6c6d50-563e-436b-9a8b-42ca95e27ade", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
16192024-12-21T07:47:54.000ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16202024-12-21T07:47:54.000ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16212024-12-21T07:47:54.000ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16222024-12-21T07:47:54.001ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16232024-12-21T07:47:54.001ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16242024-12-21T07:47:54.001ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "80d9cca2-07a4-4373-bd8e-bddbf01e3d9e", "date": "Sat, 21 Dec 2024 07:47:54 GMT"} })
16252024-12-21T07:47:54.002ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 426.620288ms iteration = 2 status = {}
16262024-12-21T07:47:54.003ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.82659ms iteration = 2 status = {}
16272024-12-21T07:47:54.099ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3eebcafa-ea0c-40f0-937a-803627758150", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
16282024-12-21T07:47:54.099ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
16292024-12-21T07:47:54.099ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16302024-12-21T07:47:54.103ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d09d4e5c-b398-470d-9e34-805af16a0dbc", "content-length": "682", "date": "Sat, 21 Dec 2024 07:47:54 GMT"} })
16312024-12-21T07:47:54.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16322024-12-21T07:47:54.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16332024-12-21T07:47:54.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16342024-12-21T07:47:54.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16352024-12-21T07:47:54.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16362024-12-21T07:47:54.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16372024-12-21T07:47:54.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16382024-12-21T07:47:54.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16392024-12-21T07:47:54.142ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 565.786104ms iteration = 2 status = {}
16402024-12-21T07:47:55.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbd38c86-4f09-4626-b392-6f8f36da0a07 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16412024-12-21T07:47:55.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbd38c86-4f09-4626-b392-6f8f36da0a07 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16422024-12-21T07:47:55.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbd38c86-4f09-4626-b392-6f8f36da0a07 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16432024-12-21T07:47:56.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d0374f5-f711-48d5-8013-32a384d2438c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16442024-12-21T07:47:56.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d0374f5-f711-48d5-8013-32a384d2438c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16452024-12-21T07:47:56.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d0374f5-f711-48d5-8013-32a384d2438c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16462024-12-21T07:47:57.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3d72c8-de67-44e7-8acc-77d4bc4c15d1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16472024-12-21T07:47:57.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3d72c8-de67-44e7-8acc-77d4bc4c15d1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16482024-12-21T07:47:57.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3d72c8-de67-44e7-8acc-77d4bc4c15d1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16492024-12-21T07:47:58.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7787d861-6b54-4108-a391-e4e9e7e57f32 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16502024-12-21T07:47:58.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7787d861-6b54-4108-a391-e4e9e7e57f32 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16512024-12-21T07:47:58.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7787d861-6b54-4108-a391-e4e9e7e57f32 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16522024-12-21T07:47:59.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99d74002-7304-4638-be68-c535fd4424c4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16532024-12-21T07:47:59.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99d74002-7304-4638-be68-c535fd4424c4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16542024-12-21T07:47:59.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99d74002-7304-4638-be68-c535fd4424c4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16552024-12-21T07:48:00.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31f2d646-1b88-40b9-9fd0-54d6a299b57c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16562024-12-21T07:48:00.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31f2d646-1b88-40b9-9fd0-54d6a299b57c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16572024-12-21T07:48:00.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31f2d646-1b88-40b9-9fd0-54d6a299b57c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16582024-12-21T07:48:01.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 88956f12-7919-4c80-b095-4dda06b81b43 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16592024-12-21T07:48:01.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 88956f12-7919-4c80-b095-4dda06b81b43 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16602024-12-21T07:48:01.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 88956f12-7919-4c80-b095-4dda06b81b43 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16612024-12-21T07:48:02.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a849789-88b2-4f96-9965-b26fc3131fd3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16622024-12-21T07:48:02.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a849789-88b2-4f96-9965-b26fc3131fd3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16632024-12-21T07:48:02.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a849789-88b2-4f96-9965-b26fc3131fd3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16642024-12-21T07:48:03.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06740eea-a29f-4ff9-9e9a-e3d18c064486 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16652024-12-21T07:48:03.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06740eea-a29f-4ff9-9e9a-e3d18c064486 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16662024-12-21T07:48:03.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06740eea-a29f-4ff9-9e9a-e3d18c064486 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16672024-12-21T07:48:03.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
16682024-12-21T07:48:03.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16692024-12-21T07:48:03.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
16702024-12-21T07:48:03.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16712024-12-21T07:48:03.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16722024-12-21T07:48:03.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16732024-12-21T07:48:03.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-12-21T07:48:03.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16752024-12-21T07:48:03.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16762024-12-21T07:48:03.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16772024-12-21T07:48:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16782024-12-21T07:48:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16792024-12-21T07:48:03.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16802024-12-21T07:48:03.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
16812024-12-21T07:48:03.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16822024-12-21T07:48:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16832024-12-21T07:48:03.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
16842024-12-21T07:48:03.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.158963ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
16852024-12-21T07:48:03.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16862024-12-21T07:48:03.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16872024-12-21T07:48:03.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.811055ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16882024-12-21T07:48:04.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95d1000b-1c0b-4fa1-9374-892e5fb8a0a7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16892024-12-21T07:48:04.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95d1000b-1c0b-4fa1-9374-892e5fb8a0a7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16902024-12-21T07:48:04.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95d1000b-1c0b-4fa1-9374-892e5fb8a0a7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16912024-12-21T07:48:05.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 552dadcf-47f1-4f6a-b0fb-6854ac9fc562 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16922024-12-21T07:48:05.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 552dadcf-47f1-4f6a-b0fb-6854ac9fc562 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16932024-12-21T07:48:05.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 552dadcf-47f1-4f6a-b0fb-6854ac9fc562 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
16942024-12-21T07:48:05.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 0441e4f3-0945-491f-b488-b3566605b1c5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
16952024-12-21T07:48:05.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 0441e4f3-0945-491f-b488-b3566605b1c5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
16962024-12-21T07:48:05.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = 0441e4f3-0945-491f-b488-b3566605b1c5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
16972024-12-21T07:48:05.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = f1ab93a9-4a00-4929-a555-552465babdd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
16982024-12-21T07:48:05.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = f1ab93a9-4a00-4929-a555-552465babdd2 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
16992024-12-21T07:48:05.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52412 req_id = f1ab93a9-4a00-4929-a555-552465babdd2 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
17002024-12-21T07:48:06.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffb0d7b5-4063-47fa-b771-c3d74c5a3e28 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17012024-12-21T07:48:06.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffb0d7b5-4063-47fa-b771-c3d74c5a3e28 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17022024-12-21T07:48:06.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffb0d7b5-4063-47fa-b771-c3d74c5a3e28 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17032024-12-21T07:48:07.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c548fa8-6a3d-411a-9ae6-3fac8c8931c3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17042024-12-21T07:48:07.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c548fa8-6a3d-411a-9ae6-3fac8c8931c3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17052024-12-21T07:48:07.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c548fa8-6a3d-411a-9ae6-3fac8c8931c3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17062024-12-21T07:48:08.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6b91be4-d9e3-4b36-b218-c0760e5b6a28 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17072024-12-21T07:48:08.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6b91be4-d9e3-4b36-b218-c0760e5b6a28 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17082024-12-21T07:48:08.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6b91be4-d9e3-4b36-b218-c0760e5b6a28 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17092024-12-21T07:48:09.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3cd4d62-e810-4125-9b3f-86d6ea44d0c1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17102024-12-21T07:48:09.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3cd4d62-e810-4125-9b3f-86d6ea44d0c1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17112024-12-21T07:48:09.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3cd4d62-e810-4125-9b3f-86d6ea44d0c1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17122024-12-21T07:48:10.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b06710-d856-4f38-9796-5109907921c0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17132024-12-21T07:48:10.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b06710-d856-4f38-9796-5109907921c0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17142024-12-21T07:48:10.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b06710-d856-4f38-9796-5109907921c0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17152024-12-21T07:48:11.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 933eff15-5aae-457b-a1ca-6d2a5f32efd2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17162024-12-21T07:48:11.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 933eff15-5aae-457b-a1ca-6d2a5f32efd2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17172024-12-21T07:48:11.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 933eff15-5aae-457b-a1ca-6d2a5f32efd2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17182024-12-21T07:48:12.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b843d48-ce2f-4ef5-a8cd-ee2b0e5127cc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17192024-12-21T07:48:12.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b843d48-ce2f-4ef5-a8cd-ee2b0e5127cc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17202024-12-21T07:48:12.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b843d48-ce2f-4ef5-a8cd-ee2b0e5127cc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17212024-12-21T07:48:13.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca71d9fa-fd49-4cea-99af-93eadd5ab320 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17222024-12-21T07:48:13.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca71d9fa-fd49-4cea-99af-93eadd5ab320 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17232024-12-21T07:48:13.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca71d9fa-fd49-4cea-99af-93eadd5ab320 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17242024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
17252024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
17262024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17272024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17282024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292024-12-21T07:48:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17302024-12-21T07:48:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17312024-12-21T07:48:13.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17322024-12-21T07:48:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17332024-12-21T07:48:13.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.223012ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17342024-12-21T07:48:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17352024-12-21T07:48:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17362024-12-21T07:48:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17372024-12-21T07:48:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-12-21T07:48:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-12-21T07:48:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-12-21T07:48:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
17412024-12-21T07:48:13.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17422024-12-21T07:48:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432024-12-21T07:48:13.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
17442024-12-21T07:48:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.90412ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
17452024-12-21T07:48:14.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c173dc8d-6391-48cd-ae01-d980b06478ca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17462024-12-21T07:48:14.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c173dc8d-6391-48cd-ae01-d980b06478ca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17472024-12-21T07:48:14.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c173dc8d-6391-48cd-ae01-d980b06478ca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17482024-12-21T07:48:15.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c3c4c8c9-8986-4bba-b50f-87367f8262c6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17492024-12-21T07:48:15.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c3c4c8c9-8986-4bba-b50f-87367f8262c6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17502024-12-21T07:48:15.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c3c4c8c9-8986-4bba-b50f-87367f8262c6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17512024-12-21T07:48:16.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b1f5d60-895f-4fd1-a5d9-dda891b27d40 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17522024-12-21T07:48:16.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b1f5d60-895f-4fd1-a5d9-dda891b27d40 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17532024-12-21T07:48:16.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b1f5d60-895f-4fd1-a5d9-dda891b27d40 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17542024-12-21T07:48:17.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed593251-31d3-4513-8d53-756e772ad068 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17552024-12-21T07:48:17.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed593251-31d3-4513-8d53-756e772ad068 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17562024-12-21T07:48:17.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed593251-31d3-4513-8d53-756e772ad068 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17572024-12-21T07:48:18.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e60b9e2-a8c7-4a8b-bfae-796e5bd90f35 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17582024-12-21T07:48:18.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e60b9e2-a8c7-4a8b-bfae-796e5bd90f35 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17592024-12-21T07:48:18.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e60b9e2-a8c7-4a8b-bfae-796e5bd90f35 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17602024-12-21T07:48:19.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47d8d9d0-0b00-401c-883a-0a4ed2ce7d9c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17612024-12-21T07:48:19.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47d8d9d0-0b00-401c-883a-0a4ed2ce7d9c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17622024-12-21T07:48:19.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47d8d9d0-0b00-401c-883a-0a4ed2ce7d9c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17632024-12-21T07:48:20.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c19f320-9e0d-476f-87a1-0d566aa2926c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17642024-12-21T07:48:20.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c19f320-9e0d-476f-87a1-0d566aa2926c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17652024-12-21T07:48:20.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c19f320-9e0d-476f-87a1-0d566aa2926c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17662024-12-21T07:48:21.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14af7721-b5e2-4c63-bf02-331510aabc55 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17672024-12-21T07:48:21.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14af7721-b5e2-4c63-bf02-331510aabc55 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17682024-12-21T07:48:21.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14af7721-b5e2-4c63-bf02-331510aabc55 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17692024-12-21T07:48:22.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4d9853d-02dc-4453-bd16-6964aefadf6b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17702024-12-21T07:48:22.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4d9853d-02dc-4453-bd16-6964aefadf6b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17712024-12-21T07:48:22.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4d9853d-02dc-4453-bd16-6964aefadf6b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
17722024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
17732024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17742024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
17752024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
17762024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17772024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
17782024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17792024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17802024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17812024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17822024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
17832024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17842024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
17852024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17862024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
17872024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17882024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
17892024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17902024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
17912024-12-21T07:48:23.577ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:38:23.577224555 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17922024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17932024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
17942024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
17952024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17962024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17972024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
17982024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17992024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18002024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
18012024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18022024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
18032024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18042024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
18052024-12-21T07:48:23.577ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18062024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
18072024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18082024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18092024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
18102024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18112024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18122024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
18132024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18142024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
18152024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18162024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
18172024-12-21T07:48:23.577ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18182024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 10.341\u{b5}s iteration = 3 status = {"error":"no config"}
18192024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
18202024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18212024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
18222024-12-21T07:48:23.577ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18232024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18242024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18252024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
18262024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
18272024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18282024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
18292024-12-21T07:48:23.577ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18302024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
18312024-12-21T07:48:23.577ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
18322024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 15.36\u{b5}s iteration = 3 status = {"error":"no config"}
18332024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
18342024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.71\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
18352024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
18362024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
18372024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18382024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18392024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18402024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18412024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18422024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18432024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18442024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18452024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18462024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18472024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18482024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18492024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18502024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18512024-12-21T07:48:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18522024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18532024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18542024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18552024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18562024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18582024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18592024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18602024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18612024-12-21T07:48:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18622024-12-21T07:48:23.578ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 532693960 } })
18632024-12-21T07:48:23.578ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 532883793 } })
18642024-12-21T07:48:23.579ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
18652024-12-21T07:48:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.993484ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
18662024-12-21T07:48:23.579ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
18672024-12-21T07:48:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.094826ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
18682024-12-21T07:48:23.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692024-12-21T07:48:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.168027ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18702024-12-21T07:48:23.586ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18712024-12-21T07:48:23.586ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18722024-12-21T07:48:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.652936ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18732024-12-21T07:48:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18742024-12-21T07:48:23.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18752024-12-21T07:48:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18762024-12-21T07:48:23.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 546137541 } })
18772024-12-21T07:48:23.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18782024-12-21T07:48:23.595ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:38:23.577224555 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18792024-12-21T07:48:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.461447ms iteration = 2 status = {"expiration":"2024-12-21T07:38:23.577224555Z","pruned":[]}
18802024-12-21T07:48:23.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 552614452 } })
18812024-12-21T07:48:23.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18822024-12-21T07:48:23.599ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18832024-12-21T07:48:23.599ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18842024-12-21T07:48:23.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18852024-12-21T07:48:23.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18862024-12-21T07:48:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18872024-12-21T07:48:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18882024-12-21T07:48:23.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892024-12-21T07:48:23.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18912024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932024-12-21T07:48:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18942024-12-21T07:48:23.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18952024-12-21T07:48:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18962024-12-21T07:48:23.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18972024-12-21T07:48:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18982024-12-21T07:48:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 34.229087ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
18992024-12-21T07:48:23.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0be56906-7675-49c1-b620-9cedcca6b831 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
19002024-12-21T07:48:23.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19012024-12-21T07:48:23.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0be56906-7675-49c1-b620-9cedcca6b831 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
19022024-12-21T07:48:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19032024-12-21T07:48:23.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19042024-12-21T07:48:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19052024-12-21T07:48:23.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19062024-12-21T07:48:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19072024-12-21T07:48:23.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19082024-12-21T07:48:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19092024-12-21T07:48:23.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19102024-12-21T07:48:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19112024-12-21T07:48:23.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19122024-12-21T07:48:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.866214ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
19132024-12-21T07:48:23.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0be56906-7675-49c1-b620-9cedcca6b831 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
19142024-12-21T07:48:23.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19152024-12-21T07:48:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19162024-12-21T07:48:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19172024-12-21T07:48:23.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-12-21T07:48:23.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19192024-12-21T07:48:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19202024-12-21T07:48:23.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-12-21T07:48:23.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222024-12-21T07:48:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
19232024-12-21T07:48:23.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19242024-12-21T07:48:23.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19252024-12-21T07:48:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19262024-12-21T07:48:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19272024-12-21T07:48:23.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19282024-12-21T07:48:23.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19292024-12-21T07:48:23.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19302024-12-21T07:48:23.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19312024-12-21T07:48:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19322024-12-21T07:48:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19332024-12-21T07:48:23.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19342024-12-21T07:48:23.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352024-12-21T07:48:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19362024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.820923ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19372024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.621907ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
19392024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19402024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19412024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19422024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-12-21T07:48:23.674ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19442024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19452024-12-21T07:48:23.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19462024-12-21T07:48:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19472024-12-21T07:48:23.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19482024-12-21T07:48:23.675ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19492024-12-21T07:48:23.676ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e191dcdf-ef2a-482e-a4f5-a3f4e5aaf4e4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
19502024-12-21T07:48:23.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19512024-12-21T07:48:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19522024-12-21T07:48:23.678ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19532024-12-21T07:48:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19542024-12-21T07:48:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19552024-12-21T07:48:23.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19562024-12-21T07:48:23.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572024-12-21T07:48:23.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19582024-12-21T07:48:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19592024-12-21T07:48:23.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19602024-12-21T07:48:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19612024-12-21T07:48:23.684ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19622024-12-21T07:48:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.893544ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19632024-12-21T07:48:23.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19642024-12-21T07:48:23.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19652024-12-21T07:48:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.756706ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19662024-12-21T07:48:23.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19672024-12-21T07:48:23.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19682024-12-21T07:48:23.687ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19692024-12-21T07:48:23.687ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7972248-aa3c-45c3-94c0-c87634789006", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
19702024-12-21T07:48:23.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19712024-12-21T07:48:23.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19722024-12-21T07:48:23.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19732024-12-21T07:48:23.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 644464667 } })
19742024-12-21T07:48:23.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
19752024-12-21T07:48:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19762024-12-21T07:48:23.702ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
19772024-12-21T07:48:23.702ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.017775ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
19782024-12-21T07:48:23.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19792024-12-21T07:48:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19802024-12-21T07:48:23.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19812024-12-21T07:48:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19822024-12-21T07:48:23.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19832024-12-21T07:48:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
19842024-12-21T07:48:23.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19852024-12-21T07:48:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19862024-12-21T07:48:23.719ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.567115ms iteration = 3 status = 0
19872024-12-21T07:48:23.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19882024-12-21T07:48:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19892024-12-21T07:48:23.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 155.975116ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19902024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19912024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19922024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19932024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19942024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19952024-12-21T07:48:23.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19962024-12-21T07:48:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19972024-12-21T07:48:23.738ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19982024-12-21T07:48:23.738ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19992024-12-21T07:48:23.738ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 160.658455ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20002024-12-21T07:48:23.740ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20012024-12-21T07:48:23.740ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20022024-12-21T07:48:23.740ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20032024-12-21T07:48:23.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20042024-12-21T07:48:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20052024-12-21T07:48:23.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20062024-12-21T07:48:23.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20072024-12-21T07:48:23.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.05422ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20082024-12-21T07:48:23.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20092024-12-21T07:48:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20102024-12-21T07:48:23.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20112024-12-21T07:48:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20122024-12-21T07:48:23.767ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20132024-12-21T07:48:23.767ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "23cd0199-936f-490c-b3d2-49b69d15d995", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:22 GMT"} })
20142024-12-21T07:48:23.768ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20152024-12-21T07:48:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20162024-12-21T07:48:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.197331ms iteration = 3 status = null
20172024-12-21T07:48:23.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 204.933205ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20182024-12-21T07:48:23.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20192024-12-21T07:48:23.784ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.676322ms iteration = 3 status = {}
20202024-12-21T07:48:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20212024-12-21T07:48:23.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20222024-12-21T07:48:23.785ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
20232024-12-21T07:48:23.785ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20242024-12-21T07:48:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20252024-12-21T07:48:23.786ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c74a39-e4eb-4f33-97fb-2fb5ffb96bb8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
20262024-12-21T07:48:23.786ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20272024-12-21T07:48:23.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
20282024-12-21T07:48:23.788ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20292024-12-21T07:48:23.788ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
20302024-12-21T07:48:23.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20312024-12-21T07:48:23.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20322024-12-21T07:48:23.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20332024-12-21T07:48:23.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20342024-12-21T07:48:23.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-12-21T07:48:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20362024-12-21T07:48:23.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20372024-12-21T07:48:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20382024-12-21T07:48:23.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20392024-12-21T07:48:23.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20402024-12-21T07:48:23.818ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20412024-12-21T07:48:23.819ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20422024-12-21T07:48:23.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20432024-12-21T07:48:23.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20442024-12-21T07:48:23.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-12-21T07:48:23.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20462024-12-21T07:48:23.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20472024-12-21T07:48:23.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20482024-12-21T07:48:23.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20492024-12-21T07:48:23.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20502024-12-21T07:48:23.835ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 258.528643ms iteration = 5 status = {"physical_disks_added":0}
20512024-12-21T07:48:23.843ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20522024-12-21T07:48:23.843ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 266.646553ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20532024-12-21T07:48:23.858ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20542024-12-21T07:48:23.858ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20552024-12-21T07:48:23.858ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7965fa-2b0b-4f4e-9cf9-f76d2f81fc63", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
20562024-12-21T07:48:23.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20572024-12-21T07:48:23.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20582024-12-21T07:48:23.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20592024-12-21T07:48:23.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20602024-12-21T07:48:23.860ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
20612024-12-21T07:48:23.860ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20622024-12-21T07:48:23.860ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
20632024-12-21T07:48:23.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 283.552733ms iteration = 2 status = {"generation":2}
20642024-12-21T07:48:23.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
20652024-12-21T07:48:23.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20662024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20672024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20682024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20692024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20702024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20712024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20722024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20732024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20742024-12-21T07:48:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20752024-12-21T07:48:23.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-12-21T07:48:23.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20772024-12-21T07:48:23.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20782024-12-21T07:48:23.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20792024-12-21T07:48:23.920ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
20802024-12-21T07:48:23.920ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 343.544482ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20812024-12-21T07:48:23.930ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20822024-12-21T07:48:23.930ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20832024-12-21T07:48:23.931ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72a59a65-cf4f-45a4-a02e-4ba04059e5a4", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
20842024-12-21T07:48:23.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20852024-12-21T07:48:23.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20862024-12-21T07:48:23.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20872024-12-21T07:48:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20882024-12-21T07:48:23.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20892024-12-21T07:48:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20902024-12-21T07:48:23.950ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20912024-12-21T07:48:23.950ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20922024-12-21T07:48:23.951ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c3ee4a3c-8630-448d-b1ca-1a1ffb6f044e", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
20932024-12-21T07:48:23.952ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 375.025012ms iteration = 3 status = {}
20942024-12-21T07:48:23.953ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20952024-12-21T07:48:23.959ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20962024-12-21T07:48:23.959ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "986e95e2-246e-4e6b-964c-f18674174426", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
20972024-12-21T07:48:23.959ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20982024-12-21T07:48:23.959ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20992024-12-21T07:48:23.960ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21002024-12-21T07:48:23.961ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.646907ms iteration = 3 status = {}
21012024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
21022024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
21032024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
21042024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
21052024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
21062024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
21072024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
21082024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
21092024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
21102024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
21112024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21122024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
21132024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
21142024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
21152024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
21162024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21172024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21182024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21192024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
21202024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
21212024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
21222024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
21232024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
21242024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
21252024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
21262024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
21272024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
21282024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
21292024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
21302024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
21312024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
21322024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
21332024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21342024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21352024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21362024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
21372024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21382024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
21392024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
21402024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21412024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21422024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21432024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21442024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21452024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
21462024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
21472024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
21482024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
21492024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
21502024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
21512024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
21522024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
21532024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
21542024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
21552024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
21562024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
21572024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
21582024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
21592024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21602024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21612024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
21622024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21632024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21642024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
21652024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
21662024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21672024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21682024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
21692024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
21702024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21712024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21722024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21732024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
21742024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
21752024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21762024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
21772024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
21782024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21792024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
21802024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
21812024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
21822024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
21832024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
21842024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
21852024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
21862024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
21872024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
21882024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21892024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21902024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
21912024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
21922024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
21932024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21942024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
21952024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
21962024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
21972024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
21982024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
21992024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
22002024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
22012024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
22022024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
22032024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
22042024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
22052024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
22062024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
22072024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
22082024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22092024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
22102024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
22112024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22122024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
22132024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22142024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
22152024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
22162024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22172024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22182024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22192024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22202024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22212024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
22222024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22232024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22242024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22252024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
22262024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22272024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
22282024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
22292024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22302024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22312024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
22322024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22332024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
22342024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
22352024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22362024-12-21T07:48:23.968ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
22372024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22382024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22392024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22402024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22412024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22422024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22432024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22442024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22452024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22462024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
22472024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22482024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22492024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22502024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
22512024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
22522024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
22532024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22542024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22552024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
22562024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
22572024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
22582024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
22592024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
22602024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
22612024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
22622024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
22632024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22642024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22652024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22662024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22672024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
22682024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
22692024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22702024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
22712024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
22722024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
22732024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22742024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22752024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
22762024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
22772024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22782024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
22792024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
22802024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
22812024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
22822024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
22832024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
22842024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
22852024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
22862024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
22872024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22882024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
22892024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22902024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22912024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22922024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
22932024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
22942024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
22952024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
22962024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
22972024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
22982024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
22992024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
23002024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
23012024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23022024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
23032024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
23042024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
23052024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
23062024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
23072024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
23082024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
23092024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23102024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
23112024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23122024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
23132024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
23142024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
23152024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
23162024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
23172024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
23182024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
23192024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23202024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23212024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23222024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23232024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
23242024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
23252024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
23262024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
23272024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
23282024-12-21T07:48:23.969ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
23292024-12-21T07:48:23.969ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
23302024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
23312024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
23322024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
23332024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
23342024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
23352024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
23362024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
23372024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
23382024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
23392024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
23402024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23412024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
23422024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
23432024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
23442024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
23452024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23462024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23472024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23482024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
23492024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
23502024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
23512024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
23522024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
23532024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
23542024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
23552024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
23562024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
23572024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
23582024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
23592024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
23602024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
23612024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
23622024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
23632024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
23642024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
23652024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
23662024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
23672024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
23682024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
23692024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
23702024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
23712024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
23722024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
23732024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
23742024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
23752024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
23762024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
23772024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
23782024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
23792024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
23802024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
23812024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
23822024-12-21T07:48:23.974ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
23832024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
23842024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
23852024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
23862024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
23872024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
23882024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
23892024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
23902024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
23912024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23922024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23932024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
23942024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
23952024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23962024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23972024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
23982024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
23992024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
24002024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
24012024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
24022024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
24032024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
24042024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
24052024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
24062024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
24072024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
24082024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
24092024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
24102024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
24112024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
24122024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
24132024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
24142024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
24152024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
24162024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
24172024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
24182024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
24192024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
24202024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
24212024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
24222024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24232024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
24242024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
24252024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
24262024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
24272024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
24282024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
24292024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
24302024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
24312024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
24322024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
24332024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
24342024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
24352024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
24362024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
24372024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
24382024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
24392024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
24402024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
24412024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
24422024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
24432024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
24442024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
24452024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
24462024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
24472024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
24482024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
24492024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
24502024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
24512024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
24522024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
24532024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
24542024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
24552024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
24562024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
24572024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
24582024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
24592024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
24602024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
24612024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
24622024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
24632024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
24642024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
24652024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
24662024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
24672024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
24682024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
24692024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
24702024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
24712024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
24722024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24732024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24742024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
24752024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
24762024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
24772024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
24782024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
24792024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
24802024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
24812024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
24822024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
24832024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
24842024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
24852024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
24862024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
24872024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
24882024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
24892024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
24902024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
24912024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
24922024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24932024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24942024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24952024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24962024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
24972024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
24982024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24992024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
25002024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
25012024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
25022024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
25032024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
25042024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
25052024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
25062024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
25072024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
25082024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
25092024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
25102024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
25112024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
25122024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
25132024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
25142024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
25152024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
25162024-12-21T07:48:23.975ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
25172024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
25182024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
25192024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
25202024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25212024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
25222024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
25232024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
25242024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
25252024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
25262024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
25272024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
25282024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
25292024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
25302024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
25312024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
25322024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
25332024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
25342024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
25352024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
25362024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
25372024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
25382024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
25392024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
25402024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
25412024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
25422024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
25432024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
25442024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
25452024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
25462024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
25472024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
25482024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
25492024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
25502024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
25512024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
25522024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
25532024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
25542024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
25552024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
25562024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
25572024-12-21T07:48:23.976ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
25582024-12-21T07:48:23.976ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
25592024-12-21T07:48:23.980ZDEBGnexus (nexus-producer-server): registered DTrace probes
25602024-12-21T07:48:23.981ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25612024-12-21T07:48:23.981ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25622024-12-21T07:48:23.981ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
25632024-12-21T07:48:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 404.06608ms iteration = 2 status = {"generation":1}
25642024-12-21T07:48:23.981ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
25652024-12-21T07:48:23.985ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:37319 method = GET path = /{producer_id} versions = all
25662024-12-21T07:48:23.986ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:37319
25672024-12-21T07:48:23.986ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:37319
25682024-12-21T07:48:23.986ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:37319
25692024-12-21T07:48:23.986ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
25702024-12-21T07:48:23.986ZDEBGnexus (nexus-producer-server): starting producer registration task
25712024-12-21T07:48:23.986ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:37319 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
25722024-12-21T07:48:23.986ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25732024-12-21T07:48:23.986ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
25742024-12-21T07:48:23.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25752024-12-21T07:48:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25762024-12-21T07:48:23.993ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
25772024-12-21T07:48:23.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25782024-12-21T07:48:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25792024-12-21T07:48:24.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25802024-12-21T07:48:24.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c2a650c-d419-4962-af79-6dc9c1dbaab4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
25812024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25822024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
25832024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25842024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25852024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25862024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25872024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25882024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25892024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25902024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25912024-12-21T07:48:24.019ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
25922024-12-21T07:48:24.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25932024-12-21T07:48:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25942024-12-21T07:48:24.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25952024-12-21T07:48:24.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7a199a3a-b81e-42dc-be09-06d73f8ae8d8", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25962024-12-21T07:48:24.021ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25972024-12-21T07:48:24.022ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25982024-12-21T07:48:24.022ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "031cba63-2c04-4f88-8b9b-e3316ebf3250", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
25992024-12-21T07:48:24.022ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26002024-12-21T07:48:24.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5d8679b7-7d4f-4354-8c86-c46b8eac0d42", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26012024-12-21T07:48:24.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26022024-12-21T07:48:24.022ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b775b0b-8d35-481e-a7c4-f21f6769eefc", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
26032024-12-21T07:48:24.022ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
26042024-12-21T07:48:24.022ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26052024-12-21T07:48:24.024ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26062024-12-21T07:48:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 163.20677ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26072024-12-21T07:48:24.055ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26082024-12-21T07:48:24.055ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
26092024-12-21T07:48:24.055ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:32828
26102024-12-21T07:48:24.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32828 req_id = e56a5fb9-9e4a-4bb0-aabb-31623ca77023 roles = RoleSet { roles: {} } uri = /metrics/producers
26112024-12-21T07:48:24.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32828 req_id = e56a5fb9-9e4a-4bb0-aabb-31623ca77023 resource = Database result = Ok(()) uri = /metrics/producers
26122024-12-21T07:48:24.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26132024-12-21T07:48:24.099ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
26142024-12-21T07:48:24.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46080 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:32828 req_id = e56a5fb9-9e4a-4bb0-aabb-31623ca77023 response_code = 201 uri = /metrics/producers
26152024-12-21T07:48:24.101ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e56a5fb9-9e4a-4bb0-aabb-31623ca77023", "content-length": "41", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} })
26162024-12-21T07:48:24.103ZDEBGnexus (producer-registration-task): registered with nexus successfully
26172024-12-21T07:48:24.103ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26182024-12-21T07:48:24.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26192024-12-21T07:48:24.125ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0d731932-1a6c-4ebd-aa3a-69e12695aa67", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26202024-12-21T07:48:24.125ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26212024-12-21T07:48:24.126ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7dbf27f5-0216-4a2c-b925-14577e27b7f7", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26222024-12-21T07:48:24.126ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26232024-12-21T07:48:24.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "880356a4-d988-4d3e-a6b8-e784bc8b20ed", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26242024-12-21T07:48:24.127ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26252024-12-21T07:48:24.129ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26262024-12-21T07:48:24.129ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 147.955608ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26272024-12-21T07:48:24.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c57c6a2-2f0c-40b9-8cca-b4a006143d81", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} })
26282024-12-21T07:48:24.206ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
26292024-12-21T07:48:24.206ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26302024-12-21T07:48:24.207ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb99efd8-bbe5-4c9d-b0f5-a190eb00418e", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
26312024-12-21T07:48:24.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26322024-12-21T07:48:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26332024-12-21T07:48:24.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26342024-12-21T07:48:24.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26352024-12-21T07:48:24.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26362024-12-21T07:48:24.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26372024-12-21T07:48:24.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26382024-12-21T07:48:24.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26392024-12-21T07:48:24.224ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 646.714112ms iteration = 3 status = {}
26402024-12-21T07:48:24.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81fb8d2a-a5f1-441a-9a53-9c95e3f8b239 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26412024-12-21T07:48:24.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81fb8d2a-a5f1-441a-9a53-9c95e3f8b239 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26422024-12-21T07:48:24.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81fb8d2a-a5f1-441a-9a53-9c95e3f8b239 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26432024-12-21T07:48:25.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 470aba25-7383-459e-9bde-ed0d1fe0148b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26442024-12-21T07:48:25.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 470aba25-7383-459e-9bde-ed0d1fe0148b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26452024-12-21T07:48:25.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 470aba25-7383-459e-9bde-ed0d1fe0148b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26462024-12-21T07:48:26.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = deaf83b3-5caa-48a1-8362-f69a7ca2b9e2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26472024-12-21T07:48:26.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = deaf83b3-5caa-48a1-8362-f69a7ca2b9e2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26482024-12-21T07:48:26.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = deaf83b3-5caa-48a1-8362-f69a7ca2b9e2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26492024-12-21T07:48:27.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d13d9f45-582e-4169-8c3a-109f11efce6f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26502024-12-21T07:48:27.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d13d9f45-582e-4169-8c3a-109f11efce6f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26512024-12-21T07:48:27.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d13d9f45-582e-4169-8c3a-109f11efce6f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26522024-12-21T07:48:28.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8002243-b6b5-4d8d-a477-dd1c16d0b7fb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26532024-12-21T07:48:28.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8002243-b6b5-4d8d-a477-dd1c16d0b7fb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26542024-12-21T07:48:28.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8002243-b6b5-4d8d-a477-dd1c16d0b7fb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26552024-12-21T07:48:29.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66c0652c-9f3b-447a-a953-de38e6971577 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26562024-12-21T07:48:29.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66c0652c-9f3b-447a-a953-de38e6971577 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26572024-12-21T07:48:29.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66c0652c-9f3b-447a-a953-de38e6971577 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26582024-12-21T07:48:30.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1bea2f5-f119-495b-b64d-7136eaf2ff5b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26592024-12-21T07:48:30.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1bea2f5-f119-495b-b64d-7136eaf2ff5b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26602024-12-21T07:48:30.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1bea2f5-f119-495b-b64d-7136eaf2ff5b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26612024-12-21T07:48:31.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56872692-6422-497d-a109-1717c01b1d38 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26622024-12-21T07:48:31.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56872692-6422-497d-a109-1717c01b1d38 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26632024-12-21T07:48:31.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56872692-6422-497d-a109-1717c01b1d38 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26642024-12-21T07:48:32.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 064ebe5a-84f1-457d-94e0-40433f2e3e42 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26652024-12-21T07:48:32.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 064ebe5a-84f1-457d-94e0-40433f2e3e42 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26662024-12-21T07:48:32.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 064ebe5a-84f1-457d-94e0-40433f2e3e42 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26672024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
26682024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26692024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
26702024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26712024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26722024-12-21T07:48:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26732024-12-21T07:48:33.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26742024-12-21T07:48:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26752024-12-21T07:48:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762024-12-21T07:48:33.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.890947ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26772024-12-21T07:48:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26782024-12-21T07:48:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26792024-12-21T07:48:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26802024-12-21T07:48:33.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26812024-12-21T07:48:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26822024-12-21T07:48:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26832024-12-21T07:48:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
26842024-12-21T07:48:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26852024-12-21T07:48:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26862024-12-21T07:48:33.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
26872024-12-21T07:48:33.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.748773ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
26882024-12-21T07:48:33.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 842b4d61-0de6-4e29-97db-7df9ff4ce7a7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26892024-12-21T07:48:33.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 842b4d61-0de6-4e29-97db-7df9ff4ce7a7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26902024-12-21T07:48:33.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 842b4d61-0de6-4e29-97db-7df9ff4ce7a7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26912024-12-21T07:48:34.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64dc12a9-9c1c-4426-98de-9e10ce02861c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26922024-12-21T07:48:34.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64dc12a9-9c1c-4426-98de-9e10ce02861c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26932024-12-21T07:48:34.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64dc12a9-9c1c-4426-98de-9e10ce02861c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26942024-12-21T07:48:35.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff36b00a-647f-475c-92a5-8082a0990131 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26952024-12-21T07:48:35.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff36b00a-647f-475c-92a5-8082a0990131 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26962024-12-21T07:48:35.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff36b00a-647f-475c-92a5-8082a0990131 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26972024-12-21T07:48:36.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdaaef95-147f-40fb-9835-533b95f05193 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26982024-12-21T07:48:36.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdaaef95-147f-40fb-9835-533b95f05193 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
26992024-12-21T07:48:36.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdaaef95-147f-40fb-9835-533b95f05193 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27002024-12-21T07:48:37.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36bdb0a-21f4-4d98-98f7-940329252595 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27012024-12-21T07:48:37.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36bdb0a-21f4-4d98-98f7-940329252595 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27022024-12-21T07:48:37.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36bdb0a-21f4-4d98-98f7-940329252595 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27032024-12-21T07:48:38.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 113ada4d-2eab-487c-9fbe-dc71a6f24941 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27042024-12-21T07:48:38.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 113ada4d-2eab-487c-9fbe-dc71a6f24941 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27052024-12-21T07:48:38.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 113ada4d-2eab-487c-9fbe-dc71a6f24941 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27062024-12-21T07:48:40.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f21a5fb7-eadb-4a07-9f45-a1cd598b9a61 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27072024-12-21T07:48:40.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f21a5fb7-eadb-4a07-9f45-a1cd598b9a61 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27082024-12-21T07:48:40.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f21a5fb7-eadb-4a07-9f45-a1cd598b9a61 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27092024-12-21T07:48:41.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd537e-c0a1-462e-9706-d1128038a001 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27102024-12-21T07:48:41.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd537e-c0a1-462e-9706-d1128038a001 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27112024-12-21T07:48:41.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4dd537e-c0a1-462e-9706-d1128038a001 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27122024-12-21T07:48:42.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2d23b9f-5ad8-422b-b17e-c33d6a21d372 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27132024-12-21T07:48:42.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2d23b9f-5ad8-422b-b17e-c33d6a21d372 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27142024-12-21T07:48:42.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2d23b9f-5ad8-422b-b17e-c33d6a21d372 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27152024-12-21T07:48:43.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05dc6011-d970-4b64-a6cd-35a0e2feeeef roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27162024-12-21T07:48:43.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05dc6011-d970-4b64-a6cd-35a0e2feeeef resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27172024-12-21T07:48:43.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05dc6011-d970-4b64-a6cd-35a0e2feeeef response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27182024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
27192024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27202024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
27212024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27222024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27232024-12-21T07:48:43.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27242024-12-21T07:48:43.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27252024-12-21T07:48:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27262024-12-21T07:48:43.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-12-21T07:48:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27282024-12-21T07:48:43.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27292024-12-21T07:48:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27302024-12-21T07:48:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27312024-12-21T07:48:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27322024-12-21T07:48:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27332024-12-21T07:48:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
27342024-12-21T07:48:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27352024-12-21T07:48:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27362024-12-21T07:48:43.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
27372024-12-21T07:48:43.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.043734ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
27382024-12-21T07:48:43.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.761941ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27392024-12-21T07:48:44.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 499996b5-633f-4b3e-82b8-ddcb2bb35d2f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27402024-12-21T07:48:44.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 499996b5-633f-4b3e-82b8-ddcb2bb35d2f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27412024-12-21T07:48:44.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 499996b5-633f-4b3e-82b8-ddcb2bb35d2f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27422024-12-21T07:48:45.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98217c32-43b2-49a8-be1b-0550258794e0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27432024-12-21T07:48:45.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98217c32-43b2-49a8-be1b-0550258794e0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27442024-12-21T07:48:45.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98217c32-43b2-49a8-be1b-0550258794e0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27452024-12-21T07:48:45.890ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:37319 remote_addr = [fd00:1122:3344:101::d]:38212
27462024-12-21T07:48:45.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7449 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 0b010b4b-f3a1-4879-a1b1-7ecac138cd7f response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
27472024-12-21T07:48:46.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 155060ad-f087-4711-b7c1-182b1cf6c699 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27482024-12-21T07:48:46.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 155060ad-f087-4711-b7c1-182b1cf6c699 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27492024-12-21T07:48:46.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 155060ad-f087-4711-b7c1-182b1cf6c699 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27502024-12-21T07:48:47.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fafeace-eee8-4a6b-a80f-a351c440ef58 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27512024-12-21T07:48:47.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fafeace-eee8-4a6b-a80f-a351c440ef58 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27522024-12-21T07:48:47.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fafeace-eee8-4a6b-a80f-a351c440ef58 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27532024-12-21T07:48:48.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 09605e5f-3fd8-40c6-a63b-6929e98b3aa2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27542024-12-21T07:48:48.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 09605e5f-3fd8-40c6-a63b-6929e98b3aa2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27552024-12-21T07:48:48.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 09605e5f-3fd8-40c6-a63b-6929e98b3aa2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27562024-12-21T07:48:49.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f4836bf3-29bb-4e31-ab5d-f5050eebf242 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27572024-12-21T07:48:49.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f4836bf3-29bb-4e31-ab5d-f5050eebf242 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27582024-12-21T07:48:49.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f4836bf3-29bb-4e31-ab5d-f5050eebf242 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27592024-12-21T07:48:50.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 17121043-74b1-4c20-aec8-e0de4547d1bc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27602024-12-21T07:48:50.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 17121043-74b1-4c20-aec8-e0de4547d1bc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27612024-12-21T07:48:50.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 17121043-74b1-4c20-aec8-e0de4547d1bc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27622024-12-21T07:48:51.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 97330c5b-6eaa-448c-8095-83ba16c2c515 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27632024-12-21T07:48:51.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 97330c5b-6eaa-448c-8095-83ba16c2c515 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27642024-12-21T07:48:51.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 97330c5b-6eaa-448c-8095-83ba16c2c515 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27652024-12-21T07:48:52.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a501d71c-6309-4e1b-bc20-7d5edd3582b1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27662024-12-21T07:48:52.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a501d71c-6309-4e1b-bc20-7d5edd3582b1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27672024-12-21T07:48:52.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a501d71c-6309-4e1b-bc20-7d5edd3582b1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27682024-12-21T07:48:53.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbe20f1e-a356-4432-97a6-bf3d94005bd8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27692024-12-21T07:48:53.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbe20f1e-a356-4432-97a6-bf3d94005bd8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27702024-12-21T07:48:53.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbe20f1e-a356-4432-97a6-bf3d94005bd8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
27712024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
27722024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27732024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
27742024-12-21T07:48:53.578ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27752024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
27762024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27772024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27782024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
27792024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
27802024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27812024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27822024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27832024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27842024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27852024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27862024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
27872024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27882024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27892024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27902024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
27912024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27922024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
27932024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27942024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
27952024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27962024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27972024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27982024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
27992024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28002024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
28012024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
28032024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28042024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28052024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
28062024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28072024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28082024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28092024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28102024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28112024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28122024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28132024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28142024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28152024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28162024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28172024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28182024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28192024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28202024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28212024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28222024-12-21T07:48:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28232024-12-21T07:48:53.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.69417ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
28242024-12-21T07:48:53.582ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.640479ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28252024-12-21T07:48:53.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28262024-12-21T07:48:53.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28272024-12-21T07:48:53.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28282024-12-21T07:48:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28292024-12-21T07:48:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.008768ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
28302024-12-21T07:48:53.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 539217872 } })
28312024-12-21T07:48:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28322024-12-21T07:48:53.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28332024-12-21T07:48:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28342024-12-21T07:48:53.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28352024-12-21T07:48:53.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 539751431 } })
28362024-12-21T07:48:53.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28372024-12-21T07:48:53.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28382024-12-21T07:48:53.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28392024-12-21T07:48:53.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28402024-12-21T07:48:53.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28412024-12-21T07:48:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28422024-12-21T07:48:53.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28432024-12-21T07:48:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28442024-12-21T07:48:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28452024-12-21T07:48:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28462024-12-21T07:48:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28472024-12-21T07:48:53.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28482024-12-21T07:48:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28492024-12-21T07:48:53.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28502024-12-21T07:48:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28512024-12-21T07:48:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28522024-12-21T07:48:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28532024-12-21T07:48:53.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28542024-12-21T07:48:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28552024-12-21T07:48:53.602ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28562024-12-21T07:48:53.602ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28572024-12-21T07:48:53.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28582024-12-21T07:48:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28592024-12-21T07:48:53.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28602024-12-21T07:48:53.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612024-12-21T07:48:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28622024-12-21T07:48:53.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 26.858941ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28632024-12-21T07:48:53.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28642024-12-21T07:48:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28652024-12-21T07:48:53.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 558317699 } })
28662024-12-21T07:48:53.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28672024-12-21T07:48:53.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28682024-12-21T07:48:53.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
28692024-12-21T07:48:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28702024-12-21T07:48:53.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28712024-12-21T07:48:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28722024-12-21T07:48:53.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28732024-12-21T07:48:53.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28742024-12-21T07:48:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
28752024-12-21T07:48:53.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28762024-12-21T07:48:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28772024-12-21T07:48:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28782024-12-21T07:48:53.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28792024-12-21T07:48:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28802024-12-21T07:48:53.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28812024-12-21T07:48:53.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28822024-12-21T07:48:53.640ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
28832024-12-21T07:48:53.640ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.061524ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
28842024-12-21T07:48:53.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28852024-12-21T07:48:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28862024-12-21T07:48:53.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28872024-12-21T07:48:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28882024-12-21T07:48:53.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28892024-12-21T07:48:53.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902024-12-21T07:48:53.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28912024-12-21T07:48:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28922024-12-21T07:48:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28932024-12-21T07:48:53.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.835168ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28942024-12-21T07:48:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
28952024-12-21T07:48:53.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28962024-12-21T07:48:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28972024-12-21T07:48:53.657ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.449013ms iteration = 4 status = 0
28982024-12-21T07:48:53.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28992024-12-21T07:48:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29002024-12-21T07:48:53.661ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29012024-12-21T07:48:53.661ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29022024-12-21T07:48:53.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29032024-12-21T07:48:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29042024-12-21T07:48:53.665ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29052024-12-21T07:48:53.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.720205ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29062024-12-21T07:48:53.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29072024-12-21T07:48:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29082024-12-21T07:48:53.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29092024-12-21T07:48:53.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29102024-12-21T07:48:53.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29112024-12-21T07:48:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29122024-12-21T07:48:53.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29132024-12-21T07:48:53.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29142024-12-21T07:48:53.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29152024-12-21T07:48:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29162024-12-21T07:48:53.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29172024-12-21T07:48:53.681ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29182024-12-21T07:48:53.681ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9debe773-64ef-4eaf-9fdf-b0a64f9e8e9e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29192024-12-21T07:48:53.681ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29202024-12-21T07:48:53.683ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29212024-12-21T07:48:53.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.39106ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29222024-12-21T07:48:53.688ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29232024-12-21T07:48:53.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29242024-12-21T07:48:53.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29252024-12-21T07:48:53.691ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29262024-12-21T07:48:53.692ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eae2dba-0980-43a8-a438-6f70eef87a46", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29272024-12-21T07:48:53.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29282024-12-21T07:48:53.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29292024-12-21T07:48:53.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29302024-12-21T07:48:53.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29312024-12-21T07:48:53.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.355603ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29322024-12-21T07:48:53.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
29332024-12-21T07:48:53.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29342024-12-21T07:48:53.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "649fbe85-ef5b-435a-bc41-e2fc5a6b7f23", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29352024-12-21T07:48:53.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29362024-12-21T07:48:53.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
29372024-12-21T07:48:53.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.867132ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29382024-12-21T07:48:53.743ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.010031ms iteration = 6 status = {"physical_disks_added":0}
29392024-12-21T07:48:53.789ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29402024-12-21T07:48:53.790ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a987774-0f8c-4339-b3c0-236e1234d832", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29412024-12-21T07:48:53.790ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29422024-12-21T07:48:53.790ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29432024-12-21T07:48:53.790ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29442024-12-21T07:48:53.791ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 213.893239ms iteration = 4 status = {}
29452024-12-21T07:48:53.838ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29462024-12-21T07:48:53.838ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29472024-12-21T07:48:53.838ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccad14b5-92eb-49d9-bd1f-b6ed98f36566", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29482024-12-21T07:48:53.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29492024-12-21T07:48:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29502024-12-21T07:48:53.857ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29512024-12-21T07:48:53.857ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29522024-12-21T07:48:53.857ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c98b07d-b375-41e1-8cd1-2289581ce9d8", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29532024-12-21T07:48:53.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29542024-12-21T07:48:53.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29552024-12-21T07:48:53.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29562024-12-21T07:48:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29572024-12-21T07:48:53.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29582024-12-21T07:48:53.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29592024-12-21T07:48:53.868ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29602024-12-21T07:48:53.869ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29612024-12-21T07:48:53.869ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bd0ca52f-fa73-4f2c-9afe-298cbca4fb8d", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29622024-12-21T07:48:53.871ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.424192ms iteration = 4 status = {}
29632024-12-21T07:48:53.915ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 337.316265ms iteration = 4 status = {}
29642024-12-21T07:48:53.915ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29652024-12-21T07:48:53.915ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ddda241-90c1-4549-aa73-38eb577450ae", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
29662024-12-21T07:48:53.917ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29672024-12-21T07:48:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29682024-12-21T07:48:53.923ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.248211ms iteration = 4 status = null
29692024-12-21T07:48:53.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702024-12-21T07:48:53.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712024-12-21T07:48:53.958ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
29722024-12-21T07:48:53.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29732024-12-21T07:48:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29742024-12-21T07:48:54.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29752024-12-21T07:48:54.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b257cca4-1e87-4483-aa17-98a5b3a0b767", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
29762024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29772024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
29782024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29792024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29802024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29812024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29822024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29832024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29842024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29852024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29862024-12-21T07:48:54.189ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
29872024-12-21T07:48:54.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29882024-12-21T07:48:54.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29892024-12-21T07:48:54.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29902024-12-21T07:48:54.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cbb96b3-04bf-495b-a911-48546cbc134d", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
29912024-12-21T07:48:54.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29922024-12-21T07:48:54.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f526789-d45b-4c69-b060-08c176e8a0b3", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
29932024-12-21T07:48:54.192ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
29942024-12-21T07:48:54.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29952024-12-21T07:48:54.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a10bb92-be9e-433c-be27-f6b500a923ff roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
29962024-12-21T07:48:54.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a10bb92-be9e-433c-be27-f6b500a923ff resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
29972024-12-21T07:48:54.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a10bb92-be9e-433c-be27-f6b500a923ff response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
29982024-12-21T07:48:54.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9a09685a-32a7-4802-ac05-447b9c65ef6f", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
29992024-12-21T07:48:54.362ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
30002024-12-21T07:48:54.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30012024-12-21T07:48:54.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eb57338-1ced-4b03-9878-402458eaa5d1", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
30022024-12-21T07:48:54.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30032024-12-21T07:48:54.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30042024-12-21T07:48:54.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30052024-12-21T07:48:54.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30062024-12-21T07:48:54.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30072024-12-21T07:48:54.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30082024-12-21T07:48:54.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30092024-12-21T07:48:54.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30102024-12-21T07:48:54.378ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.037372ms iteration = 4 status = {}
30112024-12-21T07:48:55.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871259af-7291-4b59-b5bf-399d61732ff8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30122024-12-21T07:48:55.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871259af-7291-4b59-b5bf-399d61732ff8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30132024-12-21T07:48:55.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871259af-7291-4b59-b5bf-399d61732ff8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30142024-12-21T07:48:55.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 27326446-8d20-4a53-832c-de95c6067f09 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
30152024-12-21T07:48:56.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ecad65f-b123-4f82-b43b-107400565b99 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30162024-12-21T07:48:56.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ecad65f-b123-4f82-b43b-107400565b99 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30172024-12-21T07:48:56.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ecad65f-b123-4f82-b43b-107400565b99 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30182024-12-21T07:48:57.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdfda8fc-3407-4a41-89f9-d57330fec359 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30192024-12-21T07:48:57.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdfda8fc-3407-4a41-89f9-d57330fec359 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30202024-12-21T07:48:57.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdfda8fc-3407-4a41-89f9-d57330fec359 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30212024-12-21T07:48:58.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b8a6c83-107b-434f-94ed-5ecb611cdce9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30222024-12-21T07:48:58.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b8a6c83-107b-434f-94ed-5ecb611cdce9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30232024-12-21T07:48:58.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b8a6c83-107b-434f-94ed-5ecb611cdce9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30242024-12-21T07:48:59.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 666ec54b-5655-495b-8596-2c3ab41f1ea0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30252024-12-21T07:48:59.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 666ec54b-5655-495b-8596-2c3ab41f1ea0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30262024-12-21T07:48:59.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 666ec54b-5655-495b-8596-2c3ab41f1ea0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30272024-12-21T07:49:00.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3821eae5-74fc-4425-89f0-a0a82372cbc8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30282024-12-21T07:49:00.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3821eae5-74fc-4425-89f0-a0a82372cbc8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30292024-12-21T07:49:00.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3821eae5-74fc-4425-89f0-a0a82372cbc8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30302024-12-21T07:49:01.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d128e231-b9bd-463e-a9dc-f1266740b211 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30312024-12-21T07:49:01.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d128e231-b9bd-463e-a9dc-f1266740b211 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30322024-12-21T07:49:01.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d128e231-b9bd-463e-a9dc-f1266740b211 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30332024-12-21T07:49:02.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8256634-3fff-497c-8bcd-171378cc1862 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30342024-12-21T07:49:02.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8256634-3fff-497c-8bcd-171378cc1862 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30352024-12-21T07:49:02.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8256634-3fff-497c-8bcd-171378cc1862 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30362024-12-21T07:49:03.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d23e587-2723-496b-be25-24e044d35d07 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30372024-12-21T07:49:03.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d23e587-2723-496b-be25-24e044d35d07 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30382024-12-21T07:49:03.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d23e587-2723-496b-be25-24e044d35d07 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30392024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30402024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
30412024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30422024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30432024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30442024-12-21T07:49:03.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30452024-12-21T07:49:03.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30462024-12-21T07:49:03.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30472024-12-21T07:49:03.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30482024-12-21T07:49:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30492024-12-21T07:49:03.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30502024-12-21T07:49:03.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.763031ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30512024-12-21T07:49:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30522024-12-21T07:49:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30532024-12-21T07:49:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30542024-12-21T07:49:03.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552024-12-21T07:49:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
30562024-12-21T07:49:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30572024-12-21T07:49:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30582024-12-21T07:49:03.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
30592024-12-21T07:49:03.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.739875ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
30602024-12-21T07:49:04.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39f56782-b841-4e1b-bfbe-89ca17ebcb7e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30612024-12-21T07:49:04.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39f56782-b841-4e1b-bfbe-89ca17ebcb7e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30622024-12-21T07:49:04.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39f56782-b841-4e1b-bfbe-89ca17ebcb7e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30632024-12-21T07:49:05.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 720756c9-bfd6-491e-8fef-bfe73b71b698 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30642024-12-21T07:49:05.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 720756c9-bfd6-491e-8fef-bfe73b71b698 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30652024-12-21T07:49:05.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 720756c9-bfd6-491e-8fef-bfe73b71b698 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30662024-12-21T07:49:05.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 546 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 6c98cd0c-e912-47aa-a389-658eecc02f44 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
30672024-12-21T07:49:06.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66216aec-756c-4aa1-a4ff-a5c3b70fac13 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30682024-12-21T07:49:06.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66216aec-756c-4aa1-a4ff-a5c3b70fac13 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30692024-12-21T07:49:06.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 66216aec-756c-4aa1-a4ff-a5c3b70fac13 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30702024-12-21T07:49:07.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7307b17d-811c-4751-885e-420f863ea443 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30712024-12-21T07:49:07.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7307b17d-811c-4751-885e-420f863ea443 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30722024-12-21T07:49:07.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7307b17d-811c-4751-885e-420f863ea443 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30732024-12-21T07:49:08.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d714b7d-e5f3-4547-92b8-fdd186f718a2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30742024-12-21T07:49:08.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d714b7d-e5f3-4547-92b8-fdd186f718a2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30752024-12-21T07:49:08.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d714b7d-e5f3-4547-92b8-fdd186f718a2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30762024-12-21T07:49:09.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dcfadc0d-54d5-473d-b878-9d723d2bbcc9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30772024-12-21T07:49:09.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dcfadc0d-54d5-473d-b878-9d723d2bbcc9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30782024-12-21T07:49:09.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dcfadc0d-54d5-473d-b878-9d723d2bbcc9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30792024-12-21T07:49:10.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ba6ca3e-a127-4c0a-8a7f-d2b8a90a0775 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30802024-12-21T07:49:10.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ba6ca3e-a127-4c0a-8a7f-d2b8a90a0775 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30812024-12-21T07:49:10.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ba6ca3e-a127-4c0a-8a7f-d2b8a90a0775 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30822024-12-21T07:49:11.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 29f3461e-8fee-41f2-940c-964c2e43b3fc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30832024-12-21T07:49:11.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 29f3461e-8fee-41f2-940c-964c2e43b3fc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30842024-12-21T07:49:11.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 29f3461e-8fee-41f2-940c-964c2e43b3fc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30852024-12-21T07:49:12.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecae4875-3ade-4c63-ba0b-7c58fe68796f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30862024-12-21T07:49:12.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecae4875-3ade-4c63-ba0b-7c58fe68796f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30872024-12-21T07:49:12.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecae4875-3ade-4c63-ba0b-7c58fe68796f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
30882024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
30892024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30902024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
30912024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30922024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30932024-12-21T07:49:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30942024-12-21T07:49:13.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952024-12-21T07:49:13.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30962024-12-21T07:49:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30972024-12-21T07:49:13.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.11881ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30982024-12-21T07:49:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30992024-12-21T07:49:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31002024-12-21T07:49:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31012024-12-21T07:49:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31022024-12-21T07:49:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31032024-12-21T07:49:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042024-12-21T07:49:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
31052024-12-21T07:49:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31062024-12-21T07:49:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31072024-12-21T07:49:13.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
31082024-12-21T07:49:13.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.160769ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
31092024-12-21T07:49:13.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dfa368c5-6275-4edf-a59f-8c5e45569647 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31102024-12-21T07:49:13.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dfa368c5-6275-4edf-a59f-8c5e45569647 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31112024-12-21T07:49:13.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dfa368c5-6275-4edf-a59f-8c5e45569647 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31122024-12-21T07:49:14.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac7bc9ef-0726-4d1c-b265-91165a3a30c8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31132024-12-21T07:49:14.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac7bc9ef-0726-4d1c-b265-91165a3a30c8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31142024-12-21T07:49:14.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac7bc9ef-0726-4d1c-b265-91165a3a30c8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31152024-12-21T07:49:15.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 270cbb7b-f5cf-47af-9883-0accb581ebca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31162024-12-21T07:49:15.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 270cbb7b-f5cf-47af-9883-0accb581ebca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31172024-12-21T07:49:15.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 270cbb7b-f5cf-47af-9883-0accb581ebca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31182024-12-21T07:49:15.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 2d967d17-5cbf-4a2f-85dd-afa2a2340fcd response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
31192024-12-21T07:49:16.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9392799-d8c3-4899-aaa1-57e0ae9fd052 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31202024-12-21T07:49:16.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9392799-d8c3-4899-aaa1-57e0ae9fd052 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31212024-12-21T07:49:16.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9392799-d8c3-4899-aaa1-57e0ae9fd052 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31222024-12-21T07:49:17.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac24ff0-24d8-40f2-8360-ebdf35694f83 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31232024-12-21T07:49:17.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac24ff0-24d8-40f2-8360-ebdf35694f83 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31242024-12-21T07:49:17.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac24ff0-24d8-40f2-8360-ebdf35694f83 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31252024-12-21T07:49:18.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d640c0de-8815-4b48-a217-d08d0bbecf5c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31262024-12-21T07:49:18.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d640c0de-8815-4b48-a217-d08d0bbecf5c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31272024-12-21T07:49:18.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d640c0de-8815-4b48-a217-d08d0bbecf5c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31282024-12-21T07:49:19.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9839590-874a-480a-952b-c1b10d7d2aaa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31292024-12-21T07:49:19.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9839590-874a-480a-952b-c1b10d7d2aaa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31302024-12-21T07:49:19.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c9839590-874a-480a-952b-c1b10d7d2aaa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31312024-12-21T07:49:20.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 067a332e-7c95-4dcb-9580-6f67005396c5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31322024-12-21T07:49:20.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 067a332e-7c95-4dcb-9580-6f67005396c5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31332024-12-21T07:49:20.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 067a332e-7c95-4dcb-9580-6f67005396c5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31342024-12-21T07:49:21.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a270f70-f418-48ff-909f-7617d99d3336 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31352024-12-21T07:49:21.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a270f70-f418-48ff-909f-7617d99d3336 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31362024-12-21T07:49:21.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a270f70-f418-48ff-909f-7617d99d3336 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31372024-12-21T07:49:22.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6644f697-19af-4a1d-aa99-732158071e54 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31382024-12-21T07:49:22.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6644f697-19af-4a1d-aa99-732158071e54 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31392024-12-21T07:49:22.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6644f697-19af-4a1d-aa99-732158071e54 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
31402024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
31412024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31422024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
31432024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31442024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
31452024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31462024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31472024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31482024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31492024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31502024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31512024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31522024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
31532024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31542024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
31552024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31562024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31572024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31582024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
31592024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31602024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
31612024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31622024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31632024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31642024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31652024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31662024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31672024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31682024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31692024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
31702024-12-21T07:49:23.578ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:39:23.578956810 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31712024-12-21T07:49:23.578ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31722024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
31732024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31742024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31752024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
31762024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31772024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31782024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
31792024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31802024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31812024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
31822024-12-21T07:49:23.579ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31832024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31842024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
31852024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31862024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
31872024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31882024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31892024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31902024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
31912024-12-21T07:49:23.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31922024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31932024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
31942024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
31952024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
31962024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
31972024-12-21T07:49:23.579ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
31982024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.05\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
31992024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
32002024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32012024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32022024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32032024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
32042024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32052024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32062024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32072024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32082024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32092024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32102024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32112024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32122024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32132024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32142024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32152024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32162024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32172024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32182024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32192024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32202024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32212024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32222024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32232024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32242024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32252024-12-21T07:49:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32262024-12-21T07:49:23.579ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 531942587 } })
32272024-12-21T07:49:23.580ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 532152301 } })
32282024-12-21T07:49:23.580ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32292024-12-21T07:49:23.580ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.259731ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32302024-12-21T07:49:23.580ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32312024-12-21T07:49:23.580ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.650098ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32322024-12-21T07:49:23.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332024-12-21T07:49:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 16.396042ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32342024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32352024-12-21T07:49:23.596ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32362024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.04686ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32372024-12-21T07:49:23.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 548902088 } })
32382024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32392024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32402024-12-21T07:49:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32412024-12-21T07:49:23.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32422024-12-21T07:49:23.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-12-21T07:49:23.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32442024-12-21T07:49:23.602ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 554980222 } })
32452024-12-21T07:49:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32462024-12-21T07:49:23.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32472024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.745531ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
32492024-12-21T07:49:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32502024-12-21T07:49:23.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32512024-12-21T07:49:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32522024-12-21T07:49:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 28.810864ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32532024-12-21T07:49:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32542024-12-21T07:49:23.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32552024-12-21T07:49:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32562024-12-21T07:49:23.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32572024-12-21T07:49:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32582024-12-21T07:49:23.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32592024-12-21T07:49:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32602024-12-21T07:49:23.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32612024-12-21T07:49:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32622024-12-21T07:49:23.613ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:39:23.578956810 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32632024-12-21T07:49:23.613ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 34.808397ms iteration = 3 status = {"expiration":"2024-12-21T07:39:23.578956810Z","pruned":[]}
32642024-12-21T07:49:23.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32652024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32662024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32672024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32682024-12-21T07:49:23.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-12-21T07:49:23.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32702024-12-21T07:49:23.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32712024-12-21T07:49:23.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32722024-12-21T07:49:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32732024-12-21T07:49:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32742024-12-21T07:49:23.627ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32752024-12-21T07:49:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32762024-12-21T07:49:23.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32772024-12-21T07:49:23.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32782024-12-21T07:49:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32792024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32802024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32812024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32822024-12-21T07:49:23.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32832024-12-21T07:49:23.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32842024-12-21T07:49:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32852024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32862024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32872024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32882024-12-21T07:49:23.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32892024-12-21T07:49:23.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32902024-12-21T07:49:23.639ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32912024-12-21T07:49:23.639ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.124699ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32922024-12-21T07:49:23.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932024-12-21T07:49:23.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 592125370 } })
32942024-12-21T07:49:23.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
32952024-12-21T07:49:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32962024-12-21T07:49:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32972024-12-21T07:49:23.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32982024-12-21T07:49:23.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32992024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33012024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33022024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33032024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33042024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33052024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33062024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33072024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33082024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33092024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33102024-12-21T07:49:23.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33112024-12-21T07:49:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33122024-12-21T07:49:23.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.759104ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
33132024-12-21T07:49:23.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33142024-12-21T07:49:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33152024-12-21T07:49:23.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33162024-12-21T07:49:23.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33172024-12-21T07:49:23.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182024-12-21T07:49:23.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-12-21T07:49:23.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33202024-12-21T07:49:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33212024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33222024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33232024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33242024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33252024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33262024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33272024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33282024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33292024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
33302024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33312024-12-21T07:49:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33322024-12-21T07:49:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33332024-12-21T07:49:23.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33342024-12-21T07:49:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33352024-12-21T07:49:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.86311ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33362024-12-21T07:49:23.674ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33372024-12-21T07:49:23.674ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
33382024-12-21T07:49:23.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33392024-12-21T07:49:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33402024-12-21T07:49:23.675ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33412024-12-21T07:49:23.675ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33422024-12-21T07:49:23.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33432024-12-21T07:49:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33442024-12-21T07:49:23.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33452024-12-21T07:49:23.683ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33462024-12-21T07:49:23.683ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33472024-12-21T07:49:23.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33482024-12-21T07:49:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33492024-12-21T07:49:23.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33502024-12-21T07:49:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33512024-12-21T07:49:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33522024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
33532024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33542024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
33552024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 112.212605ms iteration = 3 status = {"generation":2}
33562024-12-21T07:49:23.693ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
33572024-12-21T07:49:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.658347ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
33582024-12-21T07:49:23.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33592024-12-21T07:49:23.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.699352ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33602024-12-21T07:49:23.695ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33612024-12-21T07:49:23.695ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33622024-12-21T07:49:23.695ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.839975ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33632024-12-21T07:49:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33642024-12-21T07:49:23.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33652024-12-21T07:49:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33662024-12-21T07:49:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.985252ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33672024-12-21T07:49:23.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33682024-12-21T07:49:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33692024-12-21T07:49:23.709ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33702024-12-21T07:49:23.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33712024-12-21T07:49:23.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33722024-12-21T07:49:23.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33732024-12-21T07:49:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33742024-12-21T07:49:23.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-12-21T07:49:23.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33762024-12-21T07:49:23.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33772024-12-21T07:49:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33782024-12-21T07:49:23.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33792024-12-21T07:49:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33802024-12-21T07:49:23.721ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33812024-12-21T07:49:23.721ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33822024-12-21T07:49:23.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33832024-12-21T07:49:23.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33842024-12-21T07:49:23.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-12-21T07:49:23.726ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33862024-12-21T07:49:23.726ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33872024-12-21T07:49:23.726ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.045762ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33882024-12-21T07:49:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33892024-12-21T07:49:23.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33902024-12-21T07:49:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33912024-12-21T07:49:23.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33922024-12-21T07:49:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33932024-12-21T07:49:23.744ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33942024-12-21T07:49:23.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
33952024-12-21T07:49:23.751ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33962024-12-21T07:49:23.751ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "340649e6-fde7-4c3a-8f39-047c6371a2c9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
33972024-12-21T07:49:23.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33982024-12-21T07:49:23.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33992024-12-21T07:49:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.746437ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34002024-12-21T07:49:23.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34012024-12-21T07:49:23.763ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34022024-12-21T07:49:23.763ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf96cb8-8b96-425b-a4d3-1f49ef9c8057", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34032024-12-21T07:49:23.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34042024-12-21T07:49:23.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34052024-12-21T07:49:23.801ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
34062024-12-21T07:49:23.801ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34072024-12-21T07:49:23.802ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a58421b-99c9-4aa4-94eb-582dab31df7f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34082024-12-21T07:49:23.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34092024-12-21T07:49:23.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34102024-12-21T07:49:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34112024-12-21T07:49:23.804ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
34122024-12-21T07:49:23.887ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34132024-12-21T07:49:23.888ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d92c42c8-a5b3-43a6-b347-a22d929fd30a", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34142024-12-21T07:49:23.888ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34152024-12-21T07:49:23.888ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34162024-12-21T07:49:23.888ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34172024-12-21T07:49:23.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-12-21T07:49:23.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 311.406901ms iteration = 5 status = {}
34192024-12-21T07:49:23.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34202024-12-21T07:49:23.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34212024-12-21T07:49:23.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34222024-12-21T07:49:23.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34232024-12-21T07:49:23.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34242024-12-21T07:49:23.927ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "01d25a49-2309-4116-a698-2bcbf4e4885e", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34252024-12-21T07:49:23.927ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34262024-12-21T07:49:23.929ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a4dfc885-c8b1-49ca-9792-ce2c98037c4b", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34272024-12-21T07:49:23.929ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34282024-12-21T07:49:23.930ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34292024-12-21T07:49:23.930ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.59361ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34302024-12-21T07:49:23.932ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 353.762507ms iteration = 5 status = {}
34312024-12-21T07:49:23.934ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34322024-12-21T07:49:23.934ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34332024-12-21T07:49:23.934ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "03795dfd-c55d-45b0-8e50-a942c961b21a", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34342024-12-21T07:49:23.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34352024-12-21T07:49:23.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34362024-12-21T07:49:23.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34372024-12-21T07:49:23.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34382024-12-21T07:49:23.937ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34392024-12-21T07:49:23.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34402024-12-21T07:49:23.937ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05c2d0fc-8e3e-41bf-9448-aae273012bc6", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34412024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34422024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34432024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
34442024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 359.380864ms iteration = 3 status = {"generation":1}
34452024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34462024-12-21T07:49:23.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34472024-12-21T07:49:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34482024-12-21T07:49:23.939ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34492024-12-21T07:49:23.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502024-12-21T07:49:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34512024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.473614ms iteration = 5 status = null
34522024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
34532024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34542024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34552024-12-21T07:49:23.945ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 366.553467ms iteration = 5 status = 0
34562024-12-21T07:49:23.954ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34572024-12-21T07:49:23.954ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34582024-12-21T07:49:23.954ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c49252d-0a51-4331-9aba-7c21a9a8858d", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34592024-12-21T07:49:23.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34602024-12-21T07:49:23.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34612024-12-21T07:49:23.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34622024-12-21T07:49:23.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34632024-12-21T07:49:23.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34642024-12-21T07:49:23.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34652024-12-21T07:49:23.964ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34662024-12-21T07:49:23.964ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34672024-12-21T07:49:23.964ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f4c84376-d3e8-416c-a405-4fc99e6eb16a", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34682024-12-21T07:49:23.966ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.353253ms iteration = 5 status = {}
34692024-12-21T07:49:23.972ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 393.626221ms iteration = 7 status = {"physical_disks_added":0}
34702024-12-21T07:49:23.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21cf2210-386a-4547-91d2-b5142e8ef965 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
34712024-12-21T07:49:23.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21cf2210-386a-4547-91d2-b5142e8ef965 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
34722024-12-21T07:49:23.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21cf2210-386a-4547-91d2-b5142e8ef965 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
34732024-12-21T07:49:23.984ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34742024-12-21T07:49:23.984ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 405.723498ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34752024-12-21T07:49:23.986ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
34762024-12-21T07:49:23.986ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 407.522939ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34772024-12-21T07:49:24.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34782024-12-21T07:49:24.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0ef8aaab-1d1b-4316-8671-ae24ac482754", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34792024-12-21T07:49:24.001ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34802024-12-21T07:49:24.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "95ca0ca9-ec75-4eed-a9b5-005deeb5a889", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34812024-12-21T07:49:24.003ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34822024-12-21T07:49:24.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9bbdfe01-b022-44b8-a625-b8d36689d4c0", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34832024-12-21T07:49:24.005ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34842024-12-21T07:49:24.007ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
34852024-12-21T07:49:24.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 428.01377ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34862024-12-21T07:49:24.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34872024-12-21T07:49:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34882024-12-21T07:49:24.042ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
34892024-12-21T07:49:24.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34902024-12-21T07:49:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34912024-12-21T07:49:24.054ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34922024-12-21T07:49:24.054ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cace618a-48e3-48d4-b8e4-6ca6534c6a4c", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
34932024-12-21T07:49:24.054ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34942024-12-21T07:49:24.054ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
34952024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34962024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34972024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34982024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34992024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35002024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35012024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35022024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35032024-12-21T07:49:24.055ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
35042024-12-21T07:49:24.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35052024-12-21T07:49:24.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35062024-12-21T07:49:24.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35072024-12-21T07:49:24.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "be9e6f07-bec4-492e-9436-0a548bdeb560", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
35082024-12-21T07:49:24.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35092024-12-21T07:49:24.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2ca43be-ef9e-417c-aa3a-397a5dfbeb8d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
35102024-12-21T07:49:24.058ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
35112024-12-21T07:49:24.058ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35122024-12-21T07:49:24.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23e5a9ad-ff76-4b4c-b83a-7ea824dcf070", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
35132024-12-21T07:49:24.166ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
35142024-12-21T07:49:24.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35152024-12-21T07:49:24.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8e658ce-89da-4771-af45-fe7df72cfb30", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
35162024-12-21T07:49:24.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35172024-12-21T07:49:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35182024-12-21T07:49:24.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35192024-12-21T07:49:24.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35202024-12-21T07:49:24.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35212024-12-21T07:49:24.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35222024-12-21T07:49:24.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35232024-12-21T07:49:24.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35242024-12-21T07:49:24.181ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 602.30927ms iteration = 5 status = {}
35252024-12-21T07:49:24.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8e1df1b-6168-4c41-a554-1879203e1d34 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35262024-12-21T07:49:24.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8e1df1b-6168-4c41-a554-1879203e1d34 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35272024-12-21T07:49:25.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c8e1df1b-6168-4c41-a554-1879203e1d34 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35282024-12-21T07:49:25.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = c28c2d64-df30-44d6-afb6-eb4469485bee response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
35292024-12-21T07:49:26.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f341f7d7-af93-4120-8947-0bc427fb9768 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35302024-12-21T07:49:26.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f341f7d7-af93-4120-8947-0bc427fb9768 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35312024-12-21T07:49:26.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f341f7d7-af93-4120-8947-0bc427fb9768 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35322024-12-21T07:49:27.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abaddd1f-a624-46b2-ac16-439c90244edf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35332024-12-21T07:49:27.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abaddd1f-a624-46b2-ac16-439c90244edf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35342024-12-21T07:49:27.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abaddd1f-a624-46b2-ac16-439c90244edf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35352024-12-21T07:49:28.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f51d1717-d03e-4185-851d-fe3a64cceeeb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35362024-12-21T07:49:28.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f51d1717-d03e-4185-851d-fe3a64cceeeb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35372024-12-21T07:49:28.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f51d1717-d03e-4185-851d-fe3a64cceeeb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35382024-12-21T07:49:29.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 345b5d51-e730-456d-9ea2-20dd14cae2ad roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35392024-12-21T07:49:29.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 345b5d51-e730-456d-9ea2-20dd14cae2ad resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35402024-12-21T07:49:29.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 345b5d51-e730-456d-9ea2-20dd14cae2ad response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35412024-12-21T07:49:30.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a4ab983c-e83c-4985-af3a-3e1bdce625d4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35422024-12-21T07:49:30.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a4ab983c-e83c-4985-af3a-3e1bdce625d4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35432024-12-21T07:49:30.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a4ab983c-e83c-4985-af3a-3e1bdce625d4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35442024-12-21T07:49:31.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f092a306-a86a-48ec-9245-aae5ae406eda roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35452024-12-21T07:49:31.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f092a306-a86a-48ec-9245-aae5ae406eda resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35462024-12-21T07:49:31.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f092a306-a86a-48ec-9245-aae5ae406eda response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35472024-12-21T07:49:32.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f700a72-7d8e-4a80-b9b7-0e83cb39b2f5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35482024-12-21T07:49:32.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f700a72-7d8e-4a80-b9b7-0e83cb39b2f5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35492024-12-21T07:49:32.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f700a72-7d8e-4a80-b9b7-0e83cb39b2f5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35502024-12-21T07:49:33.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0e5c2dd-6514-4533-9d63-36e0fd2ac1e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35512024-12-21T07:49:33.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0e5c2dd-6514-4533-9d63-36e0fd2ac1e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35522024-12-21T07:49:33.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0e5c2dd-6514-4533-9d63-36e0fd2ac1e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35532024-12-21T07:49:33.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
35542024-12-21T07:49:33.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
35552024-12-21T07:49:33.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35562024-12-21T07:49:33.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35572024-12-21T07:49:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35582024-12-21T07:49:33.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35592024-12-21T07:49:33.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-12-21T07:49:33.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35612024-12-21T07:49:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35622024-12-21T07:49:33.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.07609ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35632024-12-21T07:49:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35642024-12-21T07:49:33.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35652024-12-21T07:49:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35662024-12-21T07:49:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35672024-12-21T07:49:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35682024-12-21T07:49:33.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35692024-12-21T07:49:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
35702024-12-21T07:49:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35712024-12-21T07:49:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35722024-12-21T07:49:33.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
35732024-12-21T07:49:33.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.811325ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
35742024-12-21T07:49:34.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 00d98ee9-47ca-4d24-bcef-ecc59593210c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35752024-12-21T07:49:34.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 00d98ee9-47ca-4d24-bcef-ecc59593210c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35762024-12-21T07:49:34.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 00d98ee9-47ca-4d24-bcef-ecc59593210c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35772024-12-21T07:49:35.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9ea0e73-0129-41b5-9eed-91a1dd508592 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35782024-12-21T07:49:35.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9ea0e73-0129-41b5-9eed-91a1dd508592 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35792024-12-21T07:49:35.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9ea0e73-0129-41b5-9eed-91a1dd508592 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35802024-12-21T07:49:35.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = a22f6ef3-2dbf-4f59-b397-58aa18383fdc response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
35812024-12-21T07:49:36.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0eb2ef82-4968-44a6-925b-b38ec5f2c250 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35822024-12-21T07:49:36.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0eb2ef82-4968-44a6-925b-b38ec5f2c250 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35832024-12-21T07:49:36.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0eb2ef82-4968-44a6-925b-b38ec5f2c250 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35842024-12-21T07:49:37.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0a13a2e-8955-4241-ab74-010671d07100 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35852024-12-21T07:49:37.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0a13a2e-8955-4241-ab74-010671d07100 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35862024-12-21T07:49:37.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0a13a2e-8955-4241-ab74-010671d07100 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35872024-12-21T07:49:38.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bcf423f-0a60-4cd8-bc03-dce1eaf39b24 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35882024-12-21T07:49:38.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bcf423f-0a60-4cd8-bc03-dce1eaf39b24 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35892024-12-21T07:49:38.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bcf423f-0a60-4cd8-bc03-dce1eaf39b24 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35902024-12-21T07:49:39.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8acdcf3f-18ad-46d1-9a9e-03451d76827e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35912024-12-21T07:49:39.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8acdcf3f-18ad-46d1-9a9e-03451d76827e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35922024-12-21T07:49:39.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8acdcf3f-18ad-46d1-9a9e-03451d76827e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35932024-12-21T07:49:40.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99ae7b85-ca82-4290-9436-fb38c83678fe roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35942024-12-21T07:49:40.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99ae7b85-ca82-4290-9436-fb38c83678fe resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35952024-12-21T07:49:40.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99ae7b85-ca82-4290-9436-fb38c83678fe response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35962024-12-21T07:49:41.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95fe29eb-8dce-4a8f-a00e-07e954d3762c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35972024-12-21T07:49:41.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95fe29eb-8dce-4a8f-a00e-07e954d3762c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35982024-12-21T07:49:41.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 95fe29eb-8dce-4a8f-a00e-07e954d3762c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
35992024-12-21T07:49:42.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 692d7997-cfbb-4ca9-808e-88b08ef0b694 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36002024-12-21T07:49:42.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 692d7997-cfbb-4ca9-808e-88b08ef0b694 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36012024-12-21T07:49:42.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 692d7997-cfbb-4ca9-808e-88b08ef0b694 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36022024-12-21T07:49:43.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecb6ce44-0fc7-4030-93d4-e17cc2d50de6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36032024-12-21T07:49:43.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecb6ce44-0fc7-4030-93d4-e17cc2d50de6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36042024-12-21T07:49:43.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecb6ce44-0fc7-4030-93d4-e17cc2d50de6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36052024-12-21T07:49:43.578ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
36062024-12-21T07:49:43.578ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
36072024-12-21T07:49:43.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36082024-12-21T07:49:43.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36092024-12-21T07:49:43.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36102024-12-21T07:49:43.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36112024-12-21T07:49:43.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-12-21T07:49:43.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36132024-12-21T07:49:43.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36142024-12-21T07:49:43.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.941787ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36152024-12-21T07:49:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36162024-12-21T07:49:43.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36172024-12-21T07:49:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36182024-12-21T07:49:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36192024-12-21T07:49:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36202024-12-21T07:49:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212024-12-21T07:49:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
36222024-12-21T07:49:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36232024-12-21T07:49:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36242024-12-21T07:49:43.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
36252024-12-21T07:49:43.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.068207ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
36262024-12-21T07:49:44.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04bb4b7e-c8ac-4084-a47b-62f25996b1c6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36272024-12-21T07:49:44.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04bb4b7e-c8ac-4084-a47b-62f25996b1c6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36282024-12-21T07:49:44.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04bb4b7e-c8ac-4084-a47b-62f25996b1c6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36292024-12-21T07:49:45.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e94cfd0-daf6-4bc3-81e4-e0bbfed894f8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36302024-12-21T07:49:45.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e94cfd0-daf6-4bc3-81e4-e0bbfed894f8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36312024-12-21T07:49:45.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e94cfd0-daf6-4bc3-81e4-e0bbfed894f8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36322024-12-21T07:49:45.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 791 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 987d61e0-cbf8-404e-821d-0c21402db00b response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
36332024-12-21T07:49:46.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb1ee2-75e9-4073-a143-7b0208e3bce5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36342024-12-21T07:49:46.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb1ee2-75e9-4073-a143-7b0208e3bce5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36352024-12-21T07:49:46.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb1ee2-75e9-4073-a143-7b0208e3bce5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36362024-12-21T07:49:47.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9dc9e535-48ca-4625-b361-36c545f07ffa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36372024-12-21T07:49:47.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9dc9e535-48ca-4625-b361-36c545f07ffa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36382024-12-21T07:49:47.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9dc9e535-48ca-4625-b361-36c545f07ffa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36392024-12-21T07:49:48.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e2e304dd-ac28-45fe-b567-41ede0665a71 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36402024-12-21T07:49:48.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e2e304dd-ac28-45fe-b567-41ede0665a71 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36412024-12-21T07:49:48.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e2e304dd-ac28-45fe-b567-41ede0665a71 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36422024-12-21T07:49:49.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fbb7c72-1e99-400c-9259-5b9934d085c9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36432024-12-21T07:49:49.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fbb7c72-1e99-400c-9259-5b9934d085c9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36442024-12-21T07:49:49.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fbb7c72-1e99-400c-9259-5b9934d085c9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36452024-12-21T07:49:50.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4cc2d93-ef09-43cc-8f48-a515973f3a83 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36462024-12-21T07:49:50.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4cc2d93-ef09-43cc-8f48-a515973f3a83 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36472024-12-21T07:49:50.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4cc2d93-ef09-43cc-8f48-a515973f3a83 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36482024-12-21T07:49:51.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9d107fe-def6-494f-902c-fc2e4846f5f7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36492024-12-21T07:49:51.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9d107fe-def6-494f-902c-fc2e4846f5f7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36502024-12-21T07:49:51.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9d107fe-def6-494f-902c-fc2e4846f5f7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36512024-12-21T07:49:52.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36798a7-8c5c-433d-a3fd-c9c956146fca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36522024-12-21T07:49:52.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36798a7-8c5c-433d-a3fd-c9c956146fca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36532024-12-21T07:49:52.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f36798a7-8c5c-433d-a3fd-c9c956146fca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
36542024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
36552024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36562024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
36572024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
36582024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36592024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
36602024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36612024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36622024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
36632024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
36642024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36652024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36662024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
36672024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36682024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
36692024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36702024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
36712024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
36722024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36732024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36742024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
36752024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36762024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
36772024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36782024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
36792024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36802024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36812024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
36822024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36832024-12-21T07:49:53.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36842024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
36852024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36862024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36872024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36882024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36892024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36902024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36912024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36922024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36932024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36942024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36952024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36962024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36972024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36982024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36992024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37002024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37012024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37022024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37032024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37042024-12-21T07:49:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37052024-12-21T07:49:53.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-12-21T07:49:53.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37072024-12-21T07:49:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37082024-12-21T07:49:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37092024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37102024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.63389ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37112024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37122024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37132024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37142024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37152024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37162024-12-21T07:49:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37172024-12-21T07:49:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37182024-12-21T07:49:53.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37192024-12-21T07:49:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37202024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37212024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37222024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.863701ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
37232024-12-21T07:49:53.588ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37242024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37252024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37262024-12-21T07:49:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37272024-12-21T07:49:53.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.873939ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
37282024-12-21T07:49:53.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 541610043 } })
37292024-12-21T07:49:53.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37302024-12-21T07:49:53.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37312024-12-21T07:49:53.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37322024-12-21T07:49:53.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37332024-12-21T07:49:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37342024-12-21T07:49:53.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37352024-12-21T07:49:53.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37362024-12-21T07:49:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37372024-12-21T07:49:53.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37382024-12-21T07:49:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37392024-12-21T07:49:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37402024-12-21T07:49:53.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37412024-12-21T07:49:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37422024-12-21T07:49:53.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37432024-12-21T07:49:53.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 550949093 } })
37442024-12-21T07:49:53.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37452024-12-21T07:49:53.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37462024-12-21T07:49:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37472024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37482024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37492024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37502024-12-21T07:49:53.603ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37512024-12-21T07:49:53.603ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.109623ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37522024-12-21T07:49:53.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532024-12-21T07:49:53.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37542024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37552024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37562024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37572024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37592024-12-21T07:49:53.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 559316996 } })
37602024-12-21T07:49:53.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
37612024-12-21T07:49:53.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37622024-12-21T07:49:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37632024-12-21T07:49:53.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37642024-12-21T07:49:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37652024-12-21T07:49:53.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37662024-12-21T07:49:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
37672024-12-21T07:49:53.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682024-12-21T07:49:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692024-12-21T07:49:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37702024-12-21T07:49:53.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edb2e146-32b0-42e8-9b45-6c5f48767f13 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
37712024-12-21T07:49:53.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edb2e146-32b0-42e8-9b45-6c5f48767f13 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
37722024-12-21T07:49:53.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edb2e146-32b0-42e8-9b45-6c5f48767f13 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
37732024-12-21T07:49:53.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37742024-12-21T07:49:53.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37752024-12-21T07:49:53.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762024-12-21T07:49:53.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37772024-12-21T07:49:53.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37782024-12-21T07:49:53.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37792024-12-21T07:49:53.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802024-12-21T07:49:53.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37812024-12-21T07:49:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37822024-12-21T07:49:53.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37832024-12-21T07:49:53.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37842024-12-21T07:49:53.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37852024-12-21T07:49:53.637ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
37862024-12-21T07:49:53.637ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.245319ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
37872024-12-21T07:49:53.639ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37882024-12-21T07:49:53.639ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37892024-12-21T07:49:53.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37902024-12-21T07:49:53.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37912024-12-21T07:49:53.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37922024-12-21T07:49:53.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37932024-12-21T07:49:53.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.737443ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37942024-12-21T07:49:53.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.443813ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37952024-12-21T07:49:53.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37962024-12-21T07:49:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37972024-12-21T07:49:53.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.975299ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37982024-12-21T07:49:53.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37992024-12-21T07:49:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38002024-12-21T07:49:53.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012024-12-21T07:49:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
38022024-12-21T07:49:53.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38032024-12-21T07:49:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38042024-12-21T07:49:53.662ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.531423ms iteration = 6 status = 0
38052024-12-21T07:49:53.666ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.781838ms iteration = 8 status = {"physical_disks_added":0}
38062024-12-21T07:49:53.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38072024-12-21T07:49:53.678ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38082024-12-21T07:49:53.679ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2114249f-7e17-4a21-9bb2-c6480f51a51f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38092024-12-21T07:49:53.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38102024-12-21T07:49:53.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38112024-12-21T07:49:53.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.538216ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38122024-12-21T07:49:53.686ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38132024-12-21T07:49:53.686ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38142024-12-21T07:49:53.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.562268ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38152024-12-21T07:49:53.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38162024-12-21T07:49:53.698ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38172024-12-21T07:49:53.698ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfec019b-0552-4992-8506-5aa75101c988", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38182024-12-21T07:49:53.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38192024-12-21T07:49:53.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38202024-12-21T07:49:53.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
38212024-12-21T07:49:53.701ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38222024-12-21T07:49:53.701ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a2d8099-a27b-4865-9e8e-b896dbb5ce80", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38232024-12-21T07:49:53.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38242024-12-21T07:49:53.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
38252024-12-21T07:49:53.711ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38262024-12-21T07:49:53.711ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38272024-12-21T07:49:53.711ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8932537-0f59-4258-b0b1-657824fafd56", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38282024-12-21T07:49:53.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38292024-12-21T07:49:53.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38302024-12-21T07:49:53.728ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38312024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38322024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "33be6e5f-a142-4bf8-ab57-807aeb76838d", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38332024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38342024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38352024-12-21T07:49:53.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38362024-12-21T07:49:53.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38372024-12-21T07:49:53.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38382024-12-21T07:49:53.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38392024-12-21T07:49:53.737ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38402024-12-21T07:49:53.737ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38412024-12-21T07:49:53.737ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "125b9368-38d2-49f7-9ad6-7d29909b4773", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38422024-12-21T07:49:53.738ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.257112ms iteration = 6 status = {}
38432024-12-21T07:49:53.744ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 164.914338ms iteration = 6 status = {}
38442024-12-21T07:49:53.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38452024-12-21T07:49:53.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7df848b-413e-4bd3-b4b9-e39450b72944", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:52 GMT"} })
38462024-12-21T07:49:53.760ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38472024-12-21T07:49:53.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38482024-12-21T07:49:53.762ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.41964ms iteration = 6 status = null
38492024-12-21T07:49:53.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38502024-12-21T07:49:53.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38512024-12-21T07:49:53.844ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38522024-12-21T07:49:53.844ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "22e33c96-dfbc-4b08-953c-de02fab18847", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38532024-12-21T07:49:53.844ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38542024-12-21T07:49:53.844ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38552024-12-21T07:49:53.844ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38562024-12-21T07:49:53.845ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 265.916721ms iteration = 6 status = {}
38572024-12-21T07:49:53.846ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
38582024-12-21T07:49:53.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38592024-12-21T07:49:53.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38602024-12-21T07:49:53.856ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38612024-12-21T07:49:53.856ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3740c29d-3a34-49c7-b444-0cc67ffaafaa", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:52 GMT"} })
38622024-12-21T07:49:53.856ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38632024-12-21T07:49:53.856ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
38642024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38652024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38662024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38672024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38682024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38692024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38702024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38712024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38722024-12-21T07:49:53.857ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
38732024-12-21T07:49:53.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38742024-12-21T07:49:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38752024-12-21T07:49:53.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38762024-12-21T07:49:53.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e338cc6-7d70-4620-a25f-9925bac060e3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38772024-12-21T07:49:53.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38782024-12-21T07:49:53.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4acdb9ea-ada6-4499-8558-ced9afa20003", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38792024-12-21T07:49:53.859ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
38802024-12-21T07:49:53.859ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38812024-12-21T07:49:53.958ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c5f165c-d9fb-4951-aee3-e206152080c1", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38822024-12-21T07:49:53.958ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
38832024-12-21T07:49:53.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38842024-12-21T07:49:53.958ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "398f4530-f838-449b-8840-2c636b857717", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
38852024-12-21T07:49:53.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38862024-12-21T07:49:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38872024-12-21T07:49:54.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38882024-12-21T07:49:54.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38892024-12-21T07:49:54.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38902024-12-21T07:49:54.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38912024-12-21T07:49:54.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38922024-12-21T07:49:54.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38932024-12-21T07:49:54.088ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 508.867158ms iteration = 6 status = {}
38942024-12-21T07:49:54.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 596c3b3d-8892-4b83-b395-0236b8f3239d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
38952024-12-21T07:49:54.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 596c3b3d-8892-4b83-b395-0236b8f3239d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
38962024-12-21T07:49:54.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 596c3b3d-8892-4b83-b395-0236b8f3239d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
38972024-12-21T07:49:55.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7917c3c5-5d99-4262-bbaf-b279b20c6c1a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
38982024-12-21T07:49:55.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7917c3c5-5d99-4262-bbaf-b279b20c6c1a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
38992024-12-21T07:49:55.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7917c3c5-5d99-4262-bbaf-b279b20c6c1a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39002024-12-21T07:49:55.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 07e57b6d-aa26-4dfc-a7e1-81dd8d546af3 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
39012024-12-21T07:49:56.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b6f8598-2f2d-4317-8d4c-8b6397b20e48 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39022024-12-21T07:49:56.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b6f8598-2f2d-4317-8d4c-8b6397b20e48 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39032024-12-21T07:49:56.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b6f8598-2f2d-4317-8d4c-8b6397b20e48 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39042024-12-21T07:49:57.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f138f663-8b1f-4808-81ef-36844a43a9a1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39052024-12-21T07:49:57.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f138f663-8b1f-4808-81ef-36844a43a9a1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39062024-12-21T07:49:57.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f138f663-8b1f-4808-81ef-36844a43a9a1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39072024-12-21T07:49:58.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7dff0798-42c9-4f5f-9bca-a23d676d399e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39082024-12-21T07:49:58.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7dff0798-42c9-4f5f-9bca-a23d676d399e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39092024-12-21T07:49:58.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7dff0798-42c9-4f5f-9bca-a23d676d399e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39102024-12-21T07:49:59.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff5f9ecf-52fe-4ca0-97a5-4f7d3d444f54 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39112024-12-21T07:49:59.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff5f9ecf-52fe-4ca0-97a5-4f7d3d444f54 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39122024-12-21T07:49:59.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff5f9ecf-52fe-4ca0-97a5-4f7d3d444f54 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39132024-12-21T07:50:00.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 360fab7e-fd6b-477c-8b50-87af5d47b664 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39142024-12-21T07:50:00.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 360fab7e-fd6b-477c-8b50-87af5d47b664 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39152024-12-21T07:50:00.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 360fab7e-fd6b-477c-8b50-87af5d47b664 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39162024-12-21T07:50:01.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e91086d6-d7d2-416a-8c3a-5839fa83ac59 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39172024-12-21T07:50:01.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e91086d6-d7d2-416a-8c3a-5839fa83ac59 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39182024-12-21T07:50:01.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e91086d6-d7d2-416a-8c3a-5839fa83ac59 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39192024-12-21T07:50:02.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77647d6a-d813-40d9-a832-85d415616e2b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39202024-12-21T07:50:02.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77647d6a-d813-40d9-a832-85d415616e2b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39212024-12-21T07:50:02.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77647d6a-d813-40d9-a832-85d415616e2b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39222024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39232024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39242024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39252024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39262024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39272024-12-21T07:50:03.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282024-12-21T07:50:03.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39292024-12-21T07:50:03.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39302024-12-21T07:50:03.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-12-21T07:50:03.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.910027ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39322024-12-21T07:50:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39332024-12-21T07:50:03.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39342024-12-21T07:50:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352024-12-21T07:50:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39362024-12-21T07:50:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39372024-12-21T07:50:03.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-12-21T07:50:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
39392024-12-21T07:50:03.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39402024-12-21T07:50:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39412024-12-21T07:50:03.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
39422024-12-21T07:50:03.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.048054ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
39432024-12-21T07:50:03.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f5e8c7b-d06c-40ed-ad17-04366381f2a5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39442024-12-21T07:50:03.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f5e8c7b-d06c-40ed-ad17-04366381f2a5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39452024-12-21T07:50:03.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f5e8c7b-d06c-40ed-ad17-04366381f2a5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39462024-12-21T07:50:04.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a23b4be8-4bcd-4fcb-9ff7-3e1d9d4fe237 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39472024-12-21T07:50:04.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a23b4be8-4bcd-4fcb-9ff7-3e1d9d4fe237 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39482024-12-21T07:50:04.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a23b4be8-4bcd-4fcb-9ff7-3e1d9d4fe237 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39492024-12-21T07:50:05.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = eb420d6f-1160-4c77-b63e-7247124d879b response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
39502024-12-21T07:50:05.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f71df3d-0366-4325-b88a-ec86832c5035 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39512024-12-21T07:50:05.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f71df3d-0366-4325-b88a-ec86832c5035 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39522024-12-21T07:50:05.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f71df3d-0366-4325-b88a-ec86832c5035 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39532024-12-21T07:50:06.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2133340e-edbf-42d3-a84b-b4f43c7d8804 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39542024-12-21T07:50:06.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2133340e-edbf-42d3-a84b-b4f43c7d8804 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39552024-12-21T07:50:06.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2133340e-edbf-42d3-a84b-b4f43c7d8804 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39562024-12-21T07:50:07.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 45e520c7-fe24-4af7-ba4f-29ac43753816 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39572024-12-21T07:50:07.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 45e520c7-fe24-4af7-ba4f-29ac43753816 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39582024-12-21T07:50:07.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 45e520c7-fe24-4af7-ba4f-29ac43753816 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39592024-12-21T07:50:08.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 679802d3-b0ac-4b31-8351-74fa81b9d40d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39602024-12-21T07:50:08.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 679802d3-b0ac-4b31-8351-74fa81b9d40d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39612024-12-21T07:50:08.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 679802d3-b0ac-4b31-8351-74fa81b9d40d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39622024-12-21T07:50:09.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c16bbfe-cb01-46ab-8d48-224d882857df roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39632024-12-21T07:50:09.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c16bbfe-cb01-46ab-8d48-224d882857df resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39642024-12-21T07:50:09.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c16bbfe-cb01-46ab-8d48-224d882857df response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39652024-12-21T07:50:11.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce6f168b-e1d3-4f94-a67f-eb8ec1e07029 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39662024-12-21T07:50:11.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce6f168b-e1d3-4f94-a67f-eb8ec1e07029 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39672024-12-21T07:50:11.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce6f168b-e1d3-4f94-a67f-eb8ec1e07029 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39682024-12-21T07:50:12.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2cb1f252-5d23-4a64-ab4b-b9ab5aae5089 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39692024-12-21T07:50:12.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2cb1f252-5d23-4a64-ab4b-b9ab5aae5089 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39702024-12-21T07:50:12.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2cb1f252-5d23-4a64-ab4b-b9ab5aae5089 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39712024-12-21T07:50:13.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76d98d4a-1d0f-4a46-970d-fe189ef3a70f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39722024-12-21T07:50:13.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76d98d4a-1d0f-4a46-970d-fe189ef3a70f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39732024-12-21T07:50:13.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76d98d4a-1d0f-4a46-970d-fe189ef3a70f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39742024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
39752024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
39762024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39772024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39782024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39792024-12-21T07:50:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39802024-12-21T07:50:13.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39812024-12-21T07:50:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39822024-12-21T07:50:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39832024-12-21T07:50:13.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.744564ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39842024-12-21T07:50:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39852024-12-21T07:50:13.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39862024-12-21T07:50:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39872024-12-21T07:50:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39882024-12-21T07:50:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39892024-12-21T07:50:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-12-21T07:50:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
39912024-12-21T07:50:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39922024-12-21T07:50:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39932024-12-21T07:50:13.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
39942024-12-21T07:50:13.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.367385ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
39952024-12-21T07:50:14.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 863a0900-45b6-47ce-9d0a-dc6cd9ad878a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39962024-12-21T07:50:14.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 863a0900-45b6-47ce-9d0a-dc6cd9ad878a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39972024-12-21T07:50:14.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 863a0900-45b6-47ce-9d0a-dc6cd9ad878a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39982024-12-21T07:50:15.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f4cc083-56e4-493f-b0d0-6b3c823a93c5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
39992024-12-21T07:50:15.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f4cc083-56e4-493f-b0d0-6b3c823a93c5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40002024-12-21T07:50:15.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f4cc083-56e4-493f-b0d0-6b3c823a93c5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40012024-12-21T07:50:15.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = df6e10c5-90ac-45d1-8f30-84d334d6e2d5 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
40022024-12-21T07:50:16.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 672ec255-c826-4c30-8d6e-c0021a6ce4a4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40032024-12-21T07:50:16.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 672ec255-c826-4c30-8d6e-c0021a6ce4a4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40042024-12-21T07:50:16.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 672ec255-c826-4c30-8d6e-c0021a6ce4a4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40052024-12-21T07:50:17.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcdaabe2-f503-4e8e-8e06-5667c80fd6e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40062024-12-21T07:50:17.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcdaabe2-f503-4e8e-8e06-5667c80fd6e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40072024-12-21T07:50:17.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcdaabe2-f503-4e8e-8e06-5667c80fd6e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40082024-12-21T07:50:18.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ef84a55-3ed0-4ee4-a2b9-0c39a992979c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40092024-12-21T07:50:18.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ef84a55-3ed0-4ee4-a2b9-0c39a992979c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40102024-12-21T07:50:18.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ef84a55-3ed0-4ee4-a2b9-0c39a992979c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40112024-12-21T07:50:19.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b382b54d-76a3-48a9-8aae-c3d81d4b7350 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40122024-12-21T07:50:19.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b382b54d-76a3-48a9-8aae-c3d81d4b7350 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40132024-12-21T07:50:19.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b382b54d-76a3-48a9-8aae-c3d81d4b7350 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40142024-12-21T07:50:20.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 148d8b62-93af-4fd4-96b9-c6923e87d597 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40152024-12-21T07:50:20.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 148d8b62-93af-4fd4-96b9-c6923e87d597 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40162024-12-21T07:50:20.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 148d8b62-93af-4fd4-96b9-c6923e87d597 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40172024-12-21T07:50:21.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352efa68-de8d-4a5c-845e-982ca8564768 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40182024-12-21T07:50:21.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352efa68-de8d-4a5c-845e-982ca8564768 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40192024-12-21T07:50:21.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352efa68-de8d-4a5c-845e-982ca8564768 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40202024-12-21T07:50:22.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3859c407-d226-42e9-8526-3adb2e64cb6a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40212024-12-21T07:50:22.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3859c407-d226-42e9-8526-3adb2e64cb6a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40222024-12-21T07:50:22.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3859c407-d226-42e9-8526-3adb2e64cb6a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40232024-12-21T07:50:23.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0465a349-09ee-4196-8a0b-497729fe5cd0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40242024-12-21T07:50:23.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0465a349-09ee-4196-8a0b-497729fe5cd0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40252024-12-21T07:50:23.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0465a349-09ee-4196-8a0b-497729fe5cd0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
40262024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
40272024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40282024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
40292024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40302024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
40312024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40322024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40332024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40342024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40352024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
40362024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40372024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40382024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
40392024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
40402024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40412024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
40422024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
40432024-12-21T07:50:23.579ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:40:23.579397407 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40442024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
40452024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40462024-12-21T07:50:23.579ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
40472024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
40482024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.21\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
40492024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
40502024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
40512024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40522024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40532024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40542024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40552024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
40562024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40572024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40582024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
40592024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40602024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
40612024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40622024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
40632024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40642024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40652024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40662024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40672024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
40682024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
40692024-12-21T07:50:23.579ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40702024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40712024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40722024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40732024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40742024-12-21T07:50:23.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40752024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40762024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
40772024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40782024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40792024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40802024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
40812024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40822024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40832024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40842024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
40852024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
40862024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
40872024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40882024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40892024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40902024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40912024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
40922024-12-21T07:50:23.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40932024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40942024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40952024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40962024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40972024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40982024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40992024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41002024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41012024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41022024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41032024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41042024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41052024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41062024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41072024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41082024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41092024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41102024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41112024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41122024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41132024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41142024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41152024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41162024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41172024-12-21T07:50:23.580ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 531797104 } })
41182024-12-21T07:50:23.580ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 531842155 } })
41192024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41202024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41212024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41222024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41232024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41242024-12-21T07:50:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41252024-12-21T07:50:23.581ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41262024-12-21T07:50:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.632388ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41272024-12-21T07:50:23.581ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
41282024-12-21T07:50:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.731239ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
41292024-12-21T07:50:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41302024-12-21T07:50:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41312024-12-21T07:50:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.79563ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41322024-12-21T07:50:23.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41332024-12-21T07:50:23.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 536756369 } })
41342024-12-21T07:50:23.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
41352024-12-21T07:50:23.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41362024-12-21T07:50:23.587ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:40:23.579397407 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41372024-12-21T07:50:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.646431ms iteration = 4 status = {"expiration":"2024-12-21T07:40:23.579397407Z","pruned":[]}
41382024-12-21T07:50:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41392024-12-21T07:50:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41402024-12-21T07:50:23.588ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41412024-12-21T07:50:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41422024-12-21T07:50:23.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.761282ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
41432024-12-21T07:50:23.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 545191704 } })
41442024-12-21T07:50:23.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
41452024-12-21T07:50:23.596ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41462024-12-21T07:50:23.596ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41472024-12-21T07:50:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.078313ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41482024-12-21T07:50:23.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.635555ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41502024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41522024-12-21T07:50:23.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532024-12-21T07:50:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41542024-12-21T07:50:23.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41552024-12-21T07:50:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41562024-12-21T07:50:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41572024-12-21T07:50:23.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41582024-12-21T07:50:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41592024-12-21T07:50:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41602024-12-21T07:50:23.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41612024-12-21T07:50:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41622024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41632024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41642024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41652024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41662024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41672024-12-21T07:50:23.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41682024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.590269ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
41692024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41712024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41722024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41732024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41742024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41752024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41762024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41772024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41782024-12-21T07:50:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41792024-12-21T07:50:23.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41802024-12-21T07:50:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41812024-12-21T07:50:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41822024-12-21T07:50:23.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41832024-12-21T07:50:23.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41842024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41852024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41862024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41872024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41882024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892024-12-21T07:50:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41902024-12-21T07:50:23.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41912024-12-21T07:50:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41922024-12-21T07:50:23.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932024-12-21T07:50:23.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-12-21T07:50:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41952024-12-21T07:50:23.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41962024-12-21T07:50:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41972024-12-21T07:50:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41982024-12-21T07:50:23.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41992024-12-21T07:50:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42002024-12-21T07:50:23.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42012024-12-21T07:50:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42022024-12-21T07:50:23.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42032024-12-21T07:50:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42042024-12-21T07:50:23.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42052024-12-21T07:50:23.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42062024-12-21T07:50:23.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.182934ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42072024-12-21T07:50:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42082024-12-21T07:50:23.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42092024-12-21T07:50:23.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42102024-12-21T07:50:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42112024-12-21T07:50:23.647ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 67.707901ms iteration = 3 status = {"nsuccess":5}
42122024-12-21T07:50:23.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132024-12-21T07:50:23.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-12-21T07:50:23.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152024-12-21T07:50:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42162024-12-21T07:50:23.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42172024-12-21T07:50:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42182024-12-21T07:50:23.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42192024-12-21T07:50:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
42202024-12-21T07:50:23.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42212024-12-21T07:50:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42222024-12-21T07:50:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42232024-12-21T07:50:23.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42242024-12-21T07:50:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42252024-12-21T07:50:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42262024-12-21T07:50:23.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42272024-12-21T07:50:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42282024-12-21T07:50:23.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42292024-12-21T07:50:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42302024-12-21T07:50:23.662ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 613451175 } })
42312024-12-21T07:50:23.662ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
42322024-12-21T07:50:23.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42332024-12-21T07:50:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42342024-12-21T07:50:23.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42352024-12-21T07:50:23.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42362024-12-21T07:50:23.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42372024-12-21T07:50:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42382024-12-21T07:50:23.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42392024-12-21T07:50:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42402024-12-21T07:50:23.680ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42412024-12-21T07:50:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42422024-12-21T07:50:23.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432024-12-21T07:50:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.721031ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42442024-12-21T07:50:23.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
42452024-12-21T07:50:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.387967ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
42462024-12-21T07:50:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42472024-12-21T07:50:23.688ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42482024-12-21T07:50:23.688ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42492024-12-21T07:50:23.688ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42502024-12-21T07:50:23.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42512024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42522024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42532024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42542024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42552024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42562024-12-21T07:50:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42572024-12-21T07:50:23.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582024-12-21T07:50:23.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42592024-12-21T07:50:23.691ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42602024-12-21T07:50:23.691ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42612024-12-21T07:50:23.691ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.087473ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42622024-12-21T07:50:23.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42632024-12-21T07:50:23.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42642024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42652024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42662024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42672024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42682024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42692024-12-21T07:50:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42702024-12-21T07:50:23.699ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42712024-12-21T07:50:23.699ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.420728ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42722024-12-21T07:50:23.699ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42732024-12-21T07:50:23.699ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42742024-12-21T07:50:23.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42752024-12-21T07:50:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42762024-12-21T07:50:23.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42772024-12-21T07:50:23.702ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42782024-12-21T07:50:23.702ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42792024-12-21T07:50:23.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42802024-12-21T07:50:23.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42812024-12-21T07:50:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42822024-12-21T07:50:23.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42832024-12-21T07:50:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42842024-12-21T07:50:23.709ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42852024-12-21T07:50:23.709ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42862024-12-21T07:50:23.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42872024-12-21T07:50:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42882024-12-21T07:50:23.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42892024-12-21T07:50:23.720ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42902024-12-21T07:50:23.720ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42912024-12-21T07:50:23.720ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
42922024-12-21T07:50:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.612369ms iteration = 4 status = {"generation":1}
42932024-12-21T07:50:23.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42942024-12-21T07:50:23.724ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42952024-12-21T07:50:23.725ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ff6b1c-e015-4557-86eb-9c46fc49f354", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
42962024-12-21T07:50:23.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42972024-12-21T07:50:23.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42982024-12-21T07:50:23.732ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42992024-12-21T07:50:23.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 153.035705ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43002024-12-21T07:50:23.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43012024-12-21T07:50:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43022024-12-21T07:50:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.276948ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43032024-12-21T07:50:23.740ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
43042024-12-21T07:50:23.740ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.703127ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43052024-12-21T07:50:23.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43062024-12-21T07:50:23.741ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43072024-12-21T07:50:23.741ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec354de2-8ff6-44eb-98b9-10b52c3312a8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
43082024-12-21T07:50:23.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43092024-12-21T07:50:23.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43102024-12-21T07:50:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43112024-12-21T07:50:23.742ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43122024-12-21T07:50:23.750ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43132024-12-21T07:50:23.750ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
43142024-12-21T07:50:23.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43152024-12-21T07:50:23.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43162024-12-21T07:50:23.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43172024-12-21T07:50:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43182024-12-21T07:50:23.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43192024-12-21T07:50:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43202024-12-21T07:50:23.760ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
43212024-12-21T07:50:23.760ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43222024-12-21T07:50:23.760ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
43232024-12-21T07:50:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 180.991045ms iteration = 4 status = {"generation":2}
43242024-12-21T07:50:23.765ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43252024-12-21T07:50:23.765ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43262024-12-21T07:50:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.011521ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43272024-12-21T07:50:23.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43282024-12-21T07:50:23.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43292024-12-21T07:50:23.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43302024-12-21T07:50:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43312024-12-21T07:50:23.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322024-12-21T07:50:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
43332024-12-21T07:50:23.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43342024-12-21T07:50:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43352024-12-21T07:50:23.791ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 212.21846ms iteration = 7 status = 0
43362024-12-21T07:50:23.802ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 222.72338ms iteration = 9 status = {"physical_disks_added":0}
43372024-12-21T07:50:23.824ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43382024-12-21T07:50:23.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 244.393572ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43392024-12-21T07:50:23.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43402024-12-21T07:50:23.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43412024-12-21T07:50:23.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-12-21T07:50:23.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43432024-12-21T07:50:23.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43442024-12-21T07:50:23.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43452024-12-21T07:50:23.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43462024-12-21T07:50:23.832ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
43472024-12-21T07:50:23.832ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43482024-12-21T07:50:23.832ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec5e74d-49c4-4dbf-bdad-4ca249fd84bf", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
43492024-12-21T07:50:23.832ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43502024-12-21T07:50:23.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43512024-12-21T07:50:23.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43522024-12-21T07:50:23.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43532024-12-21T07:50:23.834ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
43542024-12-21T07:50:23.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43552024-12-21T07:50:23.923ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43562024-12-21T07:50:23.924ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc117be-b1b6-4795-ac7d-e80f9af83b3a", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
43572024-12-21T07:50:23.926ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43582024-12-21T07:50:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43592024-12-21T07:50:23.935ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.676967ms iteration = 7 status = {}
43602024-12-21T07:50:24.027ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43612024-12-21T07:50:24.027ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ee038575-1cca-4c76-ba9b-86bbb4c8aba1", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43622024-12-21T07:50:24.027ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43632024-12-21T07:50:24.030ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f98dc539-903b-4ed5-b05e-b877cb28cbb6", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43642024-12-21T07:50:24.030ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43652024-12-21T07:50:24.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "905c01f5-9ad5-4f07-9b9a-e8f210980a41", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43662024-12-21T07:50:24.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43672024-12-21T07:50:24.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43682024-12-21T07:50:24.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b6e9b77e-60ad-4ed2-8540-03fb8dad5528", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43692024-12-21T07:50:24.033ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43702024-12-21T07:50:24.033ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
43712024-12-21T07:50:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 454.041828ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43722024-12-21T07:50:24.035ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "83c634b3-5506-4b50-97d9-0ee9ff4c9cdb", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43732024-12-21T07:50:24.035ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43742024-12-21T07:50:24.037ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43752024-12-21T07:50:24.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.768201ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43762024-12-21T07:50:24.038ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43772024-12-21T07:50:24.038ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43782024-12-21T07:50:24.041ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.045154ms iteration = 7 status = null
43792024-12-21T07:50:24.104ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43802024-12-21T07:50:24.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43812024-12-21T07:50:24.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43822024-12-21T07:50:24.128ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
43832024-12-21T07:50:24.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43842024-12-21T07:50:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43852024-12-21T07:50:24.134ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2584b0d-90ef-4396-a765-d66030b08126", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
43862024-12-21T07:50:24.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43872024-12-21T07:50:24.134ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb16b6be-7ba5-4e61-92f0-e42b066f9be3", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
43882024-12-21T07:50:24.134ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43892024-12-21T07:50:24.134ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43902024-12-21T07:50:24.134ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43912024-12-21T07:50:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43922024-12-21T07:50:24.136ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 557.061374ms iteration = 7 status = {}
43932024-12-21T07:50:24.139ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43942024-12-21T07:50:24.139ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "215351c2-fb8b-4590-b18d-3b12982e0ecd", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
43952024-12-21T07:50:24.139ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43962024-12-21T07:50:24.139ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
43972024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43982024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43992024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44002024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44012024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44022024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44032024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44042024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44052024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
44062024-12-21T07:50:24.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44072024-12-21T07:50:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44082024-12-21T07:50:24.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44092024-12-21T07:50:24.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "46958505-4031-4192-8670-85adce908223", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44102024-12-21T07:50:24.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44112024-12-21T07:50:24.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "95b74f4d-ec6a-46bb-a699-b8128d5cf232", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44122024-12-21T07:50:24.143ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
44132024-12-21T07:50:24.143ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44142024-12-21T07:50:24.179ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44152024-12-21T07:50:24.179ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44162024-12-21T07:50:24.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "28af606e-ef3f-4234-8cc2-e823ae9159bd", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44172024-12-21T07:50:24.235ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
44182024-12-21T07:50:24.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44192024-12-21T07:50:24.235ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1e9fcc36-6157-4130-9453-9291887a53b2", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44202024-12-21T07:50:24.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44212024-12-21T07:50:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44222024-12-21T07:50:24.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fc40489-a5a3-4d2a-8f2d-62ef0922763d", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44232024-12-21T07:50:24.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44242024-12-21T07:50:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44252024-12-21T07:50:24.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262024-12-21T07:50:24.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44272024-12-21T07:50:24.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44282024-12-21T07:50:24.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44292024-12-21T07:50:24.245ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44302024-12-21T07:50:24.245ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44312024-12-21T07:50:24.246ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45c20e08-9f87-48fb-b39f-d1b7d4916941", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
44322024-12-21T07:50:24.247ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 667.700223ms iteration = 7 status = {}
44332024-12-21T07:50:24.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53060058-682f-42a8-ad5b-de2d87ec849a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44342024-12-21T07:50:24.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53060058-682f-42a8-ad5b-de2d87ec849a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44352024-12-21T07:50:24.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53060058-682f-42a8-ad5b-de2d87ec849a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44362024-12-21T07:50:24.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44372024-12-21T07:50:24.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44382024-12-21T07:50:24.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44392024-12-21T07:50:24.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44402024-12-21T07:50:24.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44412024-12-21T07:50:24.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44422024-12-21T07:50:24.347ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 768.082414ms iteration = 7 status = {}
44432024-12-21T07:50:25.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07930c66-a715-4f66-be3b-771febece599 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44442024-12-21T07:50:25.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07930c66-a715-4f66-be3b-771febece599 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44452024-12-21T07:50:25.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07930c66-a715-4f66-be3b-771febece599 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44462024-12-21T07:50:25.890ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = b78ce2a5-0bad-4dad-b3f2-0730e6b93d5f response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
44472024-12-21T07:50:26.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 059f4bd5-0338-4799-9ced-c46c274e020e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44482024-12-21T07:50:26.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 059f4bd5-0338-4799-9ced-c46c274e020e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44492024-12-21T07:50:26.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 059f4bd5-0338-4799-9ced-c46c274e020e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44502024-12-21T07:50:27.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cfba33c8-fdb1-4ada-8f29-79ea4c8297c8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44512024-12-21T07:50:27.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cfba33c8-fdb1-4ada-8f29-79ea4c8297c8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44522024-12-21T07:50:27.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cfba33c8-fdb1-4ada-8f29-79ea4c8297c8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44532024-12-21T07:50:28.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 73eb0eef-be06-4742-ad37-72bbadfba84b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44542024-12-21T07:50:28.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 73eb0eef-be06-4742-ad37-72bbadfba84b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44552024-12-21T07:50:28.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 73eb0eef-be06-4742-ad37-72bbadfba84b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44562024-12-21T07:50:29.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 096e3155-1b4f-4195-8f3b-cf515700f3af roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44572024-12-21T07:50:29.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 096e3155-1b4f-4195-8f3b-cf515700f3af resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44582024-12-21T07:50:29.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 096e3155-1b4f-4195-8f3b-cf515700f3af response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44592024-12-21T07:50:30.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d76ec3fa-bbe2-4e4c-860d-f9cd1626eb56 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44602024-12-21T07:50:30.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d76ec3fa-bbe2-4e4c-860d-f9cd1626eb56 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44612024-12-21T07:50:30.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d76ec3fa-bbe2-4e4c-860d-f9cd1626eb56 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44622024-12-21T07:50:31.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9eccfe31-a4b3-4081-a921-9f942bb02223 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44632024-12-21T07:50:31.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9eccfe31-a4b3-4081-a921-9f942bb02223 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44642024-12-21T07:50:31.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9eccfe31-a4b3-4081-a921-9f942bb02223 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44652024-12-21T07:50:32.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 52272292-f453-413d-aadd-88c9be3f0158 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44662024-12-21T07:50:32.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 52272292-f453-413d-aadd-88c9be3f0158 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44672024-12-21T07:50:32.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 52272292-f453-413d-aadd-88c9be3f0158 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44682024-12-21T07:50:33.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36e5dc7e-0d56-4bab-9744-2a85eeb8256b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44692024-12-21T07:50:33.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36e5dc7e-0d56-4bab-9744-2a85eeb8256b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44702024-12-21T07:50:33.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36e5dc7e-0d56-4bab-9744-2a85eeb8256b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44712024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
44722024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
44732024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44742024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44752024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44762024-12-21T07:50:33.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44772024-12-21T07:50:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782024-12-21T07:50:33.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44792024-12-21T07:50:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44802024-12-21T07:50:33.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.565098ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44812024-12-21T07:50:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44822024-12-21T07:50:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44832024-12-21T07:50:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44842024-12-21T07:50:33.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44852024-12-21T07:50:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44862024-12-21T07:50:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44872024-12-21T07:50:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
44882024-12-21T07:50:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44892024-12-21T07:50:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44902024-12-21T07:50:33.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
44912024-12-21T07:50:33.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.57294ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
44922024-12-21T07:50:34.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0bb1c7ee-61c8-400d-ab99-03d19d1a38b7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44932024-12-21T07:50:34.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0bb1c7ee-61c8-400d-ab99-03d19d1a38b7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44942024-12-21T07:50:34.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0bb1c7ee-61c8-400d-ab99-03d19d1a38b7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44952024-12-21T07:50:35.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4323652-3f95-41c5-acb2-f09b91db9a63 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44962024-12-21T07:50:35.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4323652-3f95-41c5-acb2-f09b91db9a63 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44972024-12-21T07:50:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4323652-3f95-41c5-acb2-f09b91db9a63 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
44982024-12-21T07:50:35.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 3fb4bb17-28a6-4097-ad5b-560b9d6f8cc1 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
44992024-12-21T07:50:36.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e468a6f-27f8-47c1-ab9b-e365e5f40bf9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45002024-12-21T07:50:36.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e468a6f-27f8-47c1-ab9b-e365e5f40bf9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45012024-12-21T07:50:36.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2e468a6f-27f8-47c1-ab9b-e365e5f40bf9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45022024-12-21T07:50:37.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5510b90-55d7-410f-9b58-d216d529c6b3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45032024-12-21T07:50:37.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5510b90-55d7-410f-9b58-d216d529c6b3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45042024-12-21T07:50:37.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5510b90-55d7-410f-9b58-d216d529c6b3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45052024-12-21T07:50:38.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9471aed7-db7a-4f11-b8ba-5edbfa42dac2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45062024-12-21T07:50:38.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9471aed7-db7a-4f11-b8ba-5edbfa42dac2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45072024-12-21T07:50:38.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9471aed7-db7a-4f11-b8ba-5edbfa42dac2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45082024-12-21T07:50:39.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8008ed6-07a9-4312-839c-5524582d5b7b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45092024-12-21T07:50:39.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8008ed6-07a9-4312-839c-5524582d5b7b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45102024-12-21T07:50:39.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8008ed6-07a9-4312-839c-5524582d5b7b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45112024-12-21T07:50:40.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b9b8bba1-1097-4a74-8548-d9bf29623ad2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45122024-12-21T07:50:40.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b9b8bba1-1097-4a74-8548-d9bf29623ad2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45132024-12-21T07:50:40.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b9b8bba1-1097-4a74-8548-d9bf29623ad2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45142024-12-21T07:50:41.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 238196cf-fe71-459b-9801-64300d00300d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45152024-12-21T07:50:41.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 238196cf-fe71-459b-9801-64300d00300d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45162024-12-21T07:50:41.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 238196cf-fe71-459b-9801-64300d00300d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45172024-12-21T07:50:42.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 518917df-217d-4ba1-a62c-2f744fefa4d4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45182024-12-21T07:50:42.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 518917df-217d-4ba1-a62c-2f744fefa4d4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45192024-12-21T07:50:42.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 518917df-217d-4ba1-a62c-2f744fefa4d4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45202024-12-21T07:50:43.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45212024-12-21T07:50:43.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45222024-12-21T07:50:43.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45232024-12-21T07:50:43.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45242024-12-21T07:50:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45252024-12-21T07:50:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45262024-12-21T07:50:43.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-12-21T07:50:43.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45282024-12-21T07:50:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45292024-12-21T07:50:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45302024-12-21T07:50:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45312024-12-21T07:50:43.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.477797ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45322024-12-21T07:50:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45332024-12-21T07:50:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45342024-12-21T07:50:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45352024-12-21T07:50:43.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45362024-12-21T07:50:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
45372024-12-21T07:50:43.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45382024-12-21T07:50:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45392024-12-21T07:50:43.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
45402024-12-21T07:50:43.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.218339ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
45412024-12-21T07:50:43.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 189b8516-62cd-4cbe-84b3-b15f62d4926b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45422024-12-21T07:50:43.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 189b8516-62cd-4cbe-84b3-b15f62d4926b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45432024-12-21T07:50:43.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 189b8516-62cd-4cbe-84b3-b15f62d4926b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45442024-12-21T07:50:44.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d25a7e55-9ebe-4a59-885b-8af7a10c1896 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45452024-12-21T07:50:44.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d25a7e55-9ebe-4a59-885b-8af7a10c1896 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45462024-12-21T07:50:44.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d25a7e55-9ebe-4a59-885b-8af7a10c1896 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45472024-12-21T07:50:45.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a84113a-2c3e-4520-969c-5fdc0b558d4a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45482024-12-21T07:50:45.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a84113a-2c3e-4520-969c-5fdc0b558d4a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45492024-12-21T07:50:45.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a84113a-2c3e-4520-969c-5fdc0b558d4a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45502024-12-21T07:50:45.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = d06ded27-5880-4c37-bf2f-28722a61be1d response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
45512024-12-21T07:50:46.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f8f0600-03fe-44c4-9391-72b31f287b2a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45522024-12-21T07:50:46.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f8f0600-03fe-44c4-9391-72b31f287b2a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45532024-12-21T07:50:46.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f8f0600-03fe-44c4-9391-72b31f287b2a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45542024-12-21T07:50:47.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea7d929a-7403-4ec8-9c17-ee14ed72b514 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45552024-12-21T07:50:47.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea7d929a-7403-4ec8-9c17-ee14ed72b514 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45562024-12-21T07:50:47.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea7d929a-7403-4ec8-9c17-ee14ed72b514 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45572024-12-21T07:50:48.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e5f7df7-ec5e-4767-80e5-7a98ba552681 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45582024-12-21T07:50:48.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e5f7df7-ec5e-4767-80e5-7a98ba552681 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45592024-12-21T07:50:48.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1e5f7df7-ec5e-4767-80e5-7a98ba552681 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45602024-12-21T07:50:49.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b5e3c8f7-8334-417c-9fe5-6e32e51361db roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45612024-12-21T07:50:49.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b5e3c8f7-8334-417c-9fe5-6e32e51361db resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45622024-12-21T07:50:49.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b5e3c8f7-8334-417c-9fe5-6e32e51361db response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45632024-12-21T07:50:50.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06f6131d-84df-44bb-b286-27d4e5a8d72f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45642024-12-21T07:50:50.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06f6131d-84df-44bb-b286-27d4e5a8d72f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45652024-12-21T07:50:50.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 06f6131d-84df-44bb-b286-27d4e5a8d72f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45662024-12-21T07:50:50.884ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:64612
45672024-12-21T07:50:50.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = cd433a54-ac24-42dd-91d3-b0ffcbc7012d roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
45682024-12-21T07:50:50.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = cd433a54-ac24-42dd-91d3-b0ffcbc7012d resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
45692024-12-21T07:50:50.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = cd433a54-ac24-42dd-91d3-b0ffcbc7012d response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
45702024-12-21T07:50:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 7d228379-94a1-4a52-9fb8-5cd04e17fee5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
45712024-12-21T07:50:50.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 7d228379-94a1-4a52-9fb8-5cd04e17fee5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
45722024-12-21T07:50:50.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 7d228379-94a1-4a52-9fb8-5cd04e17fee5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
45732024-12-21T07:50:51.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f953008d-4f82-4b32-a1a5-9983a817ac66 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45742024-12-21T07:50:51.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f953008d-4f82-4b32-a1a5-9983a817ac66 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45752024-12-21T07:50:51.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f953008d-4f82-4b32-a1a5-9983a817ac66 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45762024-12-21T07:50:52.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2225bd0c-a1ad-4697-a054-70420278df14 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45772024-12-21T07:50:52.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2225bd0c-a1ad-4697-a054-70420278df14 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45782024-12-21T07:50:52.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2225bd0c-a1ad-4697-a054-70420278df14 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
45792024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
45802024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45812024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
45822024-12-21T07:50:53.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45832024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
45842024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45852024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45862024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
45872024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
45882024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45892024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45902024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
45912024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
45922024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45932024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45942024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
45952024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45962024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
45972024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
45982024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45992024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46002024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46012024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46022024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
46032024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46042024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46052024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
46062024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46072024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46082024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
46092024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46102024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46112024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
46122024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46132024-12-21T07:50:53.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46142024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46152024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46162024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46172024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46182024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46192024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46202024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46212024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46222024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46232024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46242024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46252024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46262024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46272024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46282024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46292024-12-21T07:50:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46302024-12-21T07:50:53.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312024-12-21T07:50:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.539818ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46322024-12-21T07:50:53.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332024-12-21T07:50:53.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342024-12-21T07:50:53.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46352024-12-21T07:50:53.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46362024-12-21T07:50:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46372024-12-21T07:50:53.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 538011381 } })
46382024-12-21T07:50:53.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
46392024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46402024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46412024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46422024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46432024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46442024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46452024-12-21T07:50:53.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46462024-12-21T07:50:53.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46472024-12-21T07:50:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46482024-12-21T07:50:53.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 542469468 } })
46492024-12-21T07:50:53.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
46502024-12-21T07:50:53.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46512024-12-21T07:50:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46522024-12-21T07:50:53.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46532024-12-21T07:50:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46542024-12-21T07:50:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46552024-12-21T07:50:53.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46562024-12-21T07:50:53.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.383933ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
46572024-12-21T07:50:53.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.198727ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
46582024-12-21T07:50:53.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46592024-12-21T07:50:53.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46602024-12-21T07:50:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46612024-12-21T07:50:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.708053ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46622024-12-21T07:50:53.602ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 553338294 } })
46632024-12-21T07:50:53.602ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
46642024-12-21T07:50:53.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46652024-12-21T07:50:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46662024-12-21T07:50:53.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672024-12-21T07:50:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46682024-12-21T07:50:53.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46692024-12-21T07:50:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46702024-12-21T07:50:53.627ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46712024-12-21T07:50:53.627ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46722024-12-21T07:50:53.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46732024-12-21T07:50:53.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46742024-12-21T07:50:53.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-12-21T07:50:53.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46762024-12-21T07:50:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46772024-12-21T07:50:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46782024-12-21T07:50:53.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46792024-12-21T07:50:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46802024-12-21T07:50:53.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46812024-12-21T07:50:53.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46822024-12-21T07:50:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46832024-12-21T07:50:53.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46842024-12-21T07:50:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46852024-12-21T07:50:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46862024-12-21T07:50:53.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46872024-12-21T07:50:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46882024-12-21T07:50:53.649ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46892024-12-21T07:50:53.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.863788ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46902024-12-21T07:50:53.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46912024-12-21T07:50:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46922024-12-21T07:50:53.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46932024-12-21T07:50:53.703ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46942024-12-21T07:50:53.703ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ac23365-5230-4635-bc43-6a8ca1342981", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
46952024-12-21T07:50:53.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46962024-12-21T07:50:53.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46972024-12-21T07:50:53.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46982024-12-21T07:50:53.705ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46992024-12-21T07:50:53.706ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41a9ae84-723b-49a2-a045-321688d18659", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47002024-12-21T07:50:53.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47012024-12-21T07:50:53.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47022024-12-21T07:50:53.823ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 243.794291ms iteration = 8 status = {}
47032024-12-21T07:50:53.825ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47042024-12-21T07:50:53.825ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b561a6d-2ace-41f9-9b57-67ae1296ab7a", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47052024-12-21T07:50:53.826ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47062024-12-21T07:50:53.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47072024-12-21T07:50:53.834ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47082024-12-21T07:50:53.834ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47092024-12-21T07:50:53.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
47102024-12-21T07:50:53.835ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47112024-12-21T07:50:53.835ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e37587-7f20-4432-bf6c-7ad5d755dcc7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47122024-12-21T07:50:53.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47132024-12-21T07:50:53.836ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47142024-12-21T07:50:53.836ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47152024-12-21T07:50:53.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47162024-12-21T07:50:53.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 256.989638ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47172024-12-21T07:50:53.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47182024-12-21T07:50:53.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
47192024-12-21T07:50:53.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47202024-12-21T07:50:53.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47212024-12-21T07:50:53.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47222024-12-21T07:50:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47232024-12-21T07:50:53.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47242024-12-21T07:50:53.839ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 259.535961ms iteration = 8 status = null
47252024-12-21T07:50:53.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47262024-12-21T07:50:53.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47272024-12-21T07:50:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47282024-12-21T07:50:53.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-12-21T07:50:53.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47302024-12-21T07:50:53.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47312024-12-21T07:50:53.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47322024-12-21T07:50:53.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47332024-12-21T07:50:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47342024-12-21T07:50:53.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47352024-12-21T07:50:53.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47362024-12-21T07:50:53.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372024-12-21T07:50:53.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 286.620245ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47382024-12-21T07:50:53.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
47392024-12-21T07:50:53.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47402024-12-21T07:50:53.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47412024-12-21T07:50:53.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422024-12-21T07:50:53.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.54415ms iteration = 8 status = 0
47432024-12-21T07:50:53.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47442024-12-21T07:50:53.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47452024-12-21T07:50:53.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 292.872674ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47462024-12-21T07:50:53.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
47472024-12-21T07:50:53.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47482024-12-21T07:50:53.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47492024-12-21T07:50:53.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47502024-12-21T07:50:53.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47512024-12-21T07:50:53.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
47522024-12-21T07:50:53.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 308.932299ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
47532024-12-21T07:50:53.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 329.066493ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47542024-12-21T07:50:53.917ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed0f44bc-18dc-4b28-a99a-1afb3a3ee72f", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47552024-12-21T07:50:53.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47562024-12-21T07:50:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47572024-12-21T07:50:53.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2feccea1-bf30-40b7-b7b1-9c052c01ee8f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
47582024-12-21T07:50:53.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2feccea1-bf30-40b7-b7b1-9c052c01ee8f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
47592024-12-21T07:50:53.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2feccea1-bf30-40b7-b7b1-9c052c01ee8f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
47602024-12-21T07:50:53.936ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47612024-12-21T07:50:53.936ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47622024-12-21T07:50:53.942ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7c5df429-9739-4cb8-ba9f-ea95f3d3504d", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47632024-12-21T07:50:53.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47642024-12-21T07:50:53.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47652024-12-21T07:50:53.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47662024-12-21T07:50:53.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47672024-12-21T07:50:53.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 366.928393ms iteration = 10 status = {"physical_disks_added":0}
47682024-12-21T07:50:53.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47692024-12-21T07:50:53.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47702024-12-21T07:50:53.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47712024-12-21T07:50:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47722024-12-21T07:50:53.965ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47732024-12-21T07:50:53.966ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b48f9f0b-a2a0-4309-960a-86aa00886c33", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47742024-12-21T07:50:53.966ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47752024-12-21T07:50:53.966ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47762024-12-21T07:50:53.966ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47772024-12-21T07:50:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.038996ms iteration = 8 status = {}
47782024-12-21T07:50:53.967ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
47792024-12-21T07:50:53.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47802024-12-21T07:50:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47812024-12-21T07:50:53.968ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47822024-12-21T07:50:53.968ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47832024-12-21T07:50:53.968ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae742abc-3397-4111-9157-4e387ceaa75f", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47842024-12-21T07:50:53.970ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 390.758592ms iteration = 8 status = {}
47852024-12-21T07:50:53.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47862024-12-21T07:50:53.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f064ae4-1f53-4032-b942-8b5e69add781", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
47872024-12-21T07:50:53.975ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47882024-12-21T07:50:53.975ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
47892024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47902024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47912024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47922024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47932024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47942024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47952024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47962024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47972024-12-21T07:50:53.976ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
47982024-12-21T07:50:53.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47992024-12-21T07:50:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48002024-12-21T07:50:53.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48012024-12-21T07:50:53.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e45a65cd-da4a-41e1-a876-67e03fe3a929", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
48022024-12-21T07:50:53.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48032024-12-21T07:50:53.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa0973d-48e7-4141-a88b-5023a6d74ccb", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
48042024-12-21T07:50:53.978ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
48052024-12-21T07:50:53.978ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48062024-12-21T07:50:54.107ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48072024-12-21T07:50:54.107ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
48082024-12-21T07:50:54.139ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
48092024-12-21T07:50:54.139ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:38993
48102024-12-21T07:50:54.139ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "132010c1-2f75-487c-82c7-b02bfb092eab", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
48112024-12-21T07:50:54.139ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
48122024-12-21T07:50:54.139ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48132024-12-21T07:50:54.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38993 req_id = ea89502d-fa90-4d85-9e6f-c1efc7be30af roles = RoleSet { roles: {} } uri = /metrics/producers
48142024-12-21T07:50:54.140ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef772996-939b-42b2-a8cc-1ffca60135e7", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
48152024-12-21T07:50:54.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38993 req_id = ea89502d-fa90-4d85-9e6f-c1efc7be30af resource = Database result = Ok(()) uri = /metrics/producers
48162024-12-21T07:50:54.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48172024-12-21T07:50:54.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48182024-12-21T07:50:54.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48192024-12-21T07:50:54.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48202024-12-21T07:50:54.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48212024-12-21T07:50:54.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48222024-12-21T07:50:54.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48232024-12-21T07:50:54.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48242024-12-21T07:50:54.156ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 576.59239ms iteration = 8 status = {}
48252024-12-21T07:50:54.174ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
48262024-12-21T07:50:54.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34184 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38993 req_id = ea89502d-fa90-4d85-9e6f-c1efc7be30af response_code = 201 uri = /metrics/producers
48272024-12-21T07:50:54.174ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ea89502d-fa90-4d85-9e6f-c1efc7be30af", "content-length": "41", "date": "Sat, 21 Dec 2024 07:50:54 GMT"} })
48282024-12-21T07:50:54.176ZDEBGnexus (producer-registration-task): registered with nexus successfully
48292024-12-21T07:50:54.176ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48302024-12-21T07:50:54.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 26c5c046-d401-49a5-ab0f-d683ce655cfe roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48312024-12-21T07:50:54.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 26c5c046-d401-49a5-ab0f-d683ce655cfe resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48322024-12-21T07:50:54.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 26c5c046-d401-49a5-ab0f-d683ce655cfe response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48332024-12-21T07:50:55.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = bc9ca58f-f72f-4480-8026-436e98d6722c response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
48342024-12-21T07:50:55.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b07ab97-146c-494f-9027-052ba964ae2b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48352024-12-21T07:50:55.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b07ab97-146c-494f-9027-052ba964ae2b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48362024-12-21T07:50:55.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b07ab97-146c-494f-9027-052ba964ae2b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48372024-12-21T07:50:56.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c2f2a71-e493-4954-87eb-ecf53598f5cf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48382024-12-21T07:50:57.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c2f2a71-e493-4954-87eb-ecf53598f5cf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48392024-12-21T07:50:57.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0c2f2a71-e493-4954-87eb-ecf53598f5cf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48402024-12-21T07:50:58.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6d2672e-8213-4e56-9f3f-de572babcb3e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48412024-12-21T07:50:58.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6d2672e-8213-4e56-9f3f-de572babcb3e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48422024-12-21T07:50:58.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e6d2672e-8213-4e56-9f3f-de572babcb3e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48432024-12-21T07:50:59.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e34e8292-4ba7-4618-86a1-1fe1820ba00b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48442024-12-21T07:50:59.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e34e8292-4ba7-4618-86a1-1fe1820ba00b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48452024-12-21T07:50:59.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e34e8292-4ba7-4618-86a1-1fe1820ba00b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48462024-12-21T07:51:00.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdb084ab-2bb6-4e7b-814d-fedda345d2a7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48472024-12-21T07:51:00.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdb084ab-2bb6-4e7b-814d-fedda345d2a7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48482024-12-21T07:51:00.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdb084ab-2bb6-4e7b-814d-fedda345d2a7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48492024-12-21T07:51:01.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53f2584c-d7d4-4593-a0ca-bb6eeb09d33f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48502024-12-21T07:51:01.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53f2584c-d7d4-4593-a0ca-bb6eeb09d33f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48512024-12-21T07:51:01.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 53f2584c-d7d4-4593-a0ca-bb6eeb09d33f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48522024-12-21T07:51:02.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 560a42fc-2c0e-488f-bc5d-13e9461d9afc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48532024-12-21T07:51:02.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 560a42fc-2c0e-488f-bc5d-13e9461d9afc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48542024-12-21T07:51:02.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 560a42fc-2c0e-488f-bc5d-13e9461d9afc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48552024-12-21T07:51:03.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 615fbcc2-5b71-4a36-bf53-a95957d94501 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48562024-12-21T07:51:03.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 615fbcc2-5b71-4a36-bf53-a95957d94501 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48572024-12-21T07:51:03.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 615fbcc2-5b71-4a36-bf53-a95957d94501 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48582024-12-21T07:51:03.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
48592024-12-21T07:51:03.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48602024-12-21T07:51:03.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
48612024-12-21T07:51:03.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48622024-12-21T07:51:03.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48632024-12-21T07:51:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48642024-12-21T07:51:03.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48652024-12-21T07:51:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48662024-12-21T07:51:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48672024-12-21T07:51:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48682024-12-21T07:51:03.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48692024-12-21T07:51:03.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48702024-12-21T07:51:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-12-21T07:51:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
48722024-12-21T07:51:03.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48732024-12-21T07:51:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48742024-12-21T07:51:03.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
48752024-12-21T07:51:03.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.68793ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
48762024-12-21T07:51:03.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48772024-12-21T07:51:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48782024-12-21T07:51:03.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.55401ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48792024-12-21T07:51:04.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 25075f26-fe8c-4674-aa27-1d627d094944 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48802024-12-21T07:51:04.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 25075f26-fe8c-4674-aa27-1d627d094944 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48812024-12-21T07:51:04.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 25075f26-fe8c-4674-aa27-1d627d094944 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48822024-12-21T07:51:05.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5a758abc-bb6e-45e6-a4cd-2331dd3b2b4f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48832024-12-21T07:51:05.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5a758abc-bb6e-45e6-a4cd-2331dd3b2b4f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48842024-12-21T07:51:05.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5a758abc-bb6e-45e6-a4cd-2331dd3b2b4f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48852024-12-21T07:51:05.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 95464777-2b00-424f-9868-29fbba320a73 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
48862024-12-21T07:51:06.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f9f2e64-6ea1-4c13-b519-7ffc5173916f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48872024-12-21T07:51:06.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f9f2e64-6ea1-4c13-b519-7ffc5173916f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48882024-12-21T07:51:06.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f9f2e64-6ea1-4c13-b519-7ffc5173916f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48892024-12-21T07:51:07.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5132ae-88d1-4da2-8fee-622b1375e7b8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48902024-12-21T07:51:07.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5132ae-88d1-4da2-8fee-622b1375e7b8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48912024-12-21T07:51:07.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5132ae-88d1-4da2-8fee-622b1375e7b8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48922024-12-21T07:51:08.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e9b2772-9af8-4127-9744-3efa1fee1b9b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48932024-12-21T07:51:08.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e9b2772-9af8-4127-9744-3efa1fee1b9b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48942024-12-21T07:51:08.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e9b2772-9af8-4127-9744-3efa1fee1b9b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48952024-12-21T07:51:09.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77294af2-882f-492c-a65d-c9d4fec5e609 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48962024-12-21T07:51:09.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77294af2-882f-492c-a65d-c9d4fec5e609 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48972024-12-21T07:51:09.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77294af2-882f-492c-a65d-c9d4fec5e609 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48982024-12-21T07:51:10.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2052b10-34d2-48a9-b6cd-2e573eb8fd84 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
48992024-12-21T07:51:10.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2052b10-34d2-48a9-b6cd-2e573eb8fd84 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49002024-12-21T07:51:10.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f2052b10-34d2-48a9-b6cd-2e573eb8fd84 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49012024-12-21T07:51:11.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68e868a3-fa0e-4de6-996c-52decc7230e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49022024-12-21T07:51:11.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68e868a3-fa0e-4de6-996c-52decc7230e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49032024-12-21T07:51:11.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68e868a3-fa0e-4de6-996c-52decc7230e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49042024-12-21T07:51:12.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64c1afd2-068a-4094-aaa4-7aa9b1543173 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49052024-12-21T07:51:12.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64c1afd2-068a-4094-aaa4-7aa9b1543173 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49062024-12-21T07:51:12.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 64c1afd2-068a-4094-aaa4-7aa9b1543173 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49072024-12-21T07:51:13.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1303a6f-4436-40ab-8f3d-a9d76ac3e913 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49082024-12-21T07:51:13.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1303a6f-4436-40ab-8f3d-a9d76ac3e913 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49092024-12-21T07:51:13.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1303a6f-4436-40ab-8f3d-a9d76ac3e913 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49102024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49112024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49122024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49132024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49142024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49152024-12-21T07:51:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49162024-12-21T07:51:13.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49172024-12-21T07:51:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49182024-12-21T07:51:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49192024-12-21T07:51:13.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.741345ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49202024-12-21T07:51:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49212024-12-21T07:51:13.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49222024-12-21T07:51:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49232024-12-21T07:51:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49242024-12-21T07:51:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49252024-12-21T07:51:13.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49262024-12-21T07:51:13.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
49272024-12-21T07:51:13.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49282024-12-21T07:51:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49292024-12-21T07:51:13.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
49302024-12-21T07:51:13.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.272637ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
49312024-12-21T07:51:14.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 572d5072-d47d-448c-aad9-2f538b255b82 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49322024-12-21T07:51:14.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 572d5072-d47d-448c-aad9-2f538b255b82 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49332024-12-21T07:51:14.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 572d5072-d47d-448c-aad9-2f538b255b82 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49342024-12-21T07:51:15.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0c1f5da-917d-40e7-be27-fcfcb342f7bd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49352024-12-21T07:51:15.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0c1f5da-917d-40e7-be27-fcfcb342f7bd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49362024-12-21T07:51:15.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0c1f5da-917d-40e7-be27-fcfcb342f7bd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49372024-12-21T07:51:15.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 480 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 6fbc3dfe-9ef3-4c39-9e35-cffef058bbdf response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
49382024-12-21T07:51:16.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 685406e7-bf7d-4368-a41c-2395a31a4cd8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49392024-12-21T07:51:16.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 685406e7-bf7d-4368-a41c-2395a31a4cd8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49402024-12-21T07:51:16.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 685406e7-bf7d-4368-a41c-2395a31a4cd8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49412024-12-21T07:51:17.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42ec0653-2086-47ff-93fe-1e20ad49c1fe roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49422024-12-21T07:51:17.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42ec0653-2086-47ff-93fe-1e20ad49c1fe resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49432024-12-21T07:51:17.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42ec0653-2086-47ff-93fe-1e20ad49c1fe response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49442024-12-21T07:51:18.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b409c00-7cb5-4d5a-b944-9f29186b5ea2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49452024-12-21T07:51:18.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b409c00-7cb5-4d5a-b944-9f29186b5ea2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49462024-12-21T07:51:18.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b409c00-7cb5-4d5a-b944-9f29186b5ea2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49472024-12-21T07:51:19.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50ba1760-a6e6-4070-8aaa-003c7be39bf4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49482024-12-21T07:51:19.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50ba1760-a6e6-4070-8aaa-003c7be39bf4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49492024-12-21T07:51:19.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50ba1760-a6e6-4070-8aaa-003c7be39bf4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49502024-12-21T07:51:20.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8e779808-528c-4b09-8273-467323dc004b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49512024-12-21T07:51:20.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8e779808-528c-4b09-8273-467323dc004b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49522024-12-21T07:51:20.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8e779808-528c-4b09-8273-467323dc004b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49532024-12-21T07:51:20.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3d5f56ca-84a8-4086-ba83-3682eb856c94 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
49542024-12-21T07:51:20.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3d5f56ca-84a8-4086-ba83-3682eb856c94 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
49552024-12-21T07:51:20.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3d5f56ca-84a8-4086-ba83-3682eb856c94 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
49562024-12-21T07:51:20.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 0e2ca98a-3f85-4fa9-81aa-12d0733e58e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
49572024-12-21T07:51:20.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 0e2ca98a-3f85-4fa9-81aa-12d0733e58e8 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
49582024-12-21T07:51:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 0e2ca98a-3f85-4fa9-81aa-12d0733e58e8 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
49592024-12-21T07:51:21.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d71cf0e-86dd-454e-a8e5-e992b77a98e7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49602024-12-21T07:51:21.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d71cf0e-86dd-454e-a8e5-e992b77a98e7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49612024-12-21T07:51:21.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d71cf0e-86dd-454e-a8e5-e992b77a98e7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49622024-12-21T07:51:22.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ea34f2e-acd4-48e3-9ee4-25903b8739d9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49632024-12-21T07:51:22.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ea34f2e-acd4-48e3-9ee4-25903b8739d9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49642024-12-21T07:51:22.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ea34f2e-acd4-48e3-9ee4-25903b8739d9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49652024-12-21T07:51:23.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b4f308f-60a1-41e9-8ca5-38a6b02cf106 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49662024-12-21T07:51:23.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b4f308f-60a1-41e9-8ca5-38a6b02cf106 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49672024-12-21T07:51:23.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b4f308f-60a1-41e9-8ca5-38a6b02cf106 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
49682024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
49692024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49702024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
49712024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
49722024-12-21T07:51:23.579ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49732024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49742024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49752024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
49762024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
49772024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49782024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49792024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
49802024-12-21T07:51:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49812024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
49822024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49832024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
49842024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49852024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
49862024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49872024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
49882024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
49892024-12-21T07:51:23.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
49902024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.28\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
49912024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
49922024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
49932024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49942024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
49952024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
49962024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49972024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
49982024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
49992024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50002024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50012024-12-21T07:51:23.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:41:23.579883838 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50022024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50042024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
50052024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50062024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
50072024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
50082024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50092024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50102024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
50112024-12-21T07:51:23.581ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50122024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50132024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
50142024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50152024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
50162024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50172024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50182024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50192024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
50202024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50212024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50222024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50232024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50242024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50252024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50262024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
50272024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50282024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50292024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50302024-12-21T07:51:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50312024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50322024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50332024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50342024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50352024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50362024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50372024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50382024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50392024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50402024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50412024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50422024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50432024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50442024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50452024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50462024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50472024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50482024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50492024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50502024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50512024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50522024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50532024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50542024-12-21T07:51:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 531794835 } })
50552024-12-21T07:51:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 531837565 } })
50562024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
50572024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.674619ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
50582024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50592024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.75545ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50602024-12-21T07:51:23.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50622024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50632024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50642024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50652024-12-21T07:51:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50662024-12-21T07:51:23.592ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672024-12-21T07:51:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.644657ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50682024-12-21T07:51:23.594ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 545270906 } })
50692024-12-21T07:51:23.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50702024-12-21T07:51:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50712024-12-21T07:51:23.595ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50722024-12-21T07:51:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50732024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50742024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50752024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50762024-12-21T07:51:23.605ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:41:23.579883838 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50772024-12-21T07:51:23.605ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.516057ms iteration = 5 status = {"expiration":"2024-12-21T07:41:23.579883838Z","pruned":[]}
50782024-12-21T07:51:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50792024-12-21T07:51:23.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50802024-12-21T07:51:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50812024-12-21T07:51:23.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50822024-12-21T07:51:23.613ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 33.562276ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
50832024-12-21T07:51:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50842024-12-21T07:51:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50852024-12-21T07:51:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50862024-12-21T07:51:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50872024-12-21T07:51:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50882024-12-21T07:51:23.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50892024-12-21T07:51:23.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-12-21T07:51:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50912024-12-21T07:51:23.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50922024-12-21T07:51:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50932024-12-21T07:51:23.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50942024-12-21T07:51:23.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50952024-12-21T07:51:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50962024-12-21T07:51:23.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50972024-12-21T07:51:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50982024-12-21T07:51:23.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50992024-12-21T07:51:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51002024-12-21T07:51:23.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51012024-12-21T07:51:23.631ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51022024-12-21T07:51:23.631ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51032024-12-21T07:51:23.631ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.039946ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51042024-12-21T07:51:23.631ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 582469774 } })
51052024-12-21T07:51:23.632ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51062024-12-21T07:51:23.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51072024-12-21T07:51:23.632ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51082024-12-21T07:51:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51092024-12-21T07:51:23.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51102024-12-21T07:51:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51112024-12-21T07:51:23.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51122024-12-21T07:51:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51132024-12-21T07:51:23.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51142024-12-21T07:51:23.659ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51152024-12-21T07:51:23.659ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51162024-12-21T07:51:23.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51172024-12-21T07:51:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51182024-12-21T07:51:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51192024-12-21T07:51:23.660ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51202024-12-21T07:51:23.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.42696ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51212024-12-21T07:51:23.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 615056263 } })
51222024-12-21T07:51:23.664ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
51232024-12-21T07:51:23.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242024-12-21T07:51:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
51252024-12-21T07:51:23.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51262024-12-21T07:51:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51272024-12-21T07:51:23.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51282024-12-21T07:51:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51292024-12-21T07:51:23.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51302024-12-21T07:51:23.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 98.175704ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
51312024-12-21T07:51:23.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51322024-12-21T07:51:23.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51332024-12-21T07:51:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51342024-12-21T07:51:23.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 100.689717ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51352024-12-21T07:51:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51362024-12-21T07:51:23.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51372024-12-21T07:51:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51382024-12-21T07:51:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51392024-12-21T07:51:23.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51402024-12-21T07:51:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51412024-12-21T07:51:23.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
51422024-12-21T07:51:23.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.084923ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
51432024-12-21T07:51:23.690ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51442024-12-21T07:51:23.690ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51452024-12-21T07:51:23.690ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6694f523-4b0f-4a02-b860-354bb4167c07", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
51462024-12-21T07:51:23.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51472024-12-21T07:51:23.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51482024-12-21T07:51:23.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492024-12-21T07:51:23.703ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51502024-12-21T07:51:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51512024-12-21T07:51:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51522024-12-21T07:51:23.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51532024-12-21T07:51:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51542024-12-21T07:51:23.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51552024-12-21T07:51:23.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51562024-12-21T07:51:23.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51572024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.838955ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51582024-12-21T07:51:23.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 142.077506ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51592024-12-21T07:51:23.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51602024-12-21T07:51:23.729ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51612024-12-21T07:51:23.729ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51622024-12-21T07:51:23.729ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51632024-12-21T07:51:23.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51642024-12-21T07:51:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51652024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51662024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51672024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51682024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51692024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51702024-12-21T07:51:23.732ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51712024-12-21T07:51:23.732ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51722024-12-21T07:51:23.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51732024-12-21T07:51:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51742024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51752024-12-21T07:51:23.736ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51762024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 156.921452ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51772024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51782024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51792024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51802024-12-21T07:51:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51812024-12-21T07:51:23.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51822024-12-21T07:51:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51832024-12-21T07:51:23.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51842024-12-21T07:51:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51852024-12-21T07:51:23.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51862024-12-21T07:51:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51872024-12-21T07:51:23.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51882024-12-21T07:51:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51892024-12-21T07:51:23.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 184.24691ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51902024-12-21T07:51:23.771ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51912024-12-21T07:51:23.771ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51922024-12-21T07:51:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.421793ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51932024-12-21T07:51:23.775ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51942024-12-21T07:51:23.775ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
51952024-12-21T07:51:23.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51962024-12-21T07:51:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51972024-12-21T07:51:23.779ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51982024-12-21T07:51:23.779ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
51992024-12-21T07:51:23.779ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52002024-12-21T07:51:23.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52012024-12-21T07:51:23.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52022024-12-21T07:51:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.044563ms iteration = 11 status = {"physical_disks_added":0}
52032024-12-21T07:51:23.821ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52042024-12-21T07:51:23.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52052024-12-21T07:51:23.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52062024-12-21T07:51:23.837ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 257.859432ms iteration = 9 status = {}
52072024-12-21T07:51:23.902ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52082024-12-21T07:51:23.903ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f72d394b-a1d4-4fbc-952c-758a8e6e0d95", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52092024-12-21T07:51:23.903ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52102024-12-21T07:51:23.905ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ac89a688-6742-40b0-af90-97247b3141cd", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52112024-12-21T07:51:23.905ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52122024-12-21T07:51:23.906ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52132024-12-21T07:51:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.955288ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52142024-12-21T07:51:23.908ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52152024-12-21T07:51:23.908ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52162024-12-21T07:51:23.909ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "329280da-97bf-493a-bb04-a5d24323e413", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52172024-12-21T07:51:23.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52182024-12-21T07:51:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52192024-12-21T07:51:23.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52202024-12-21T07:51:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52212024-12-21T07:51:23.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 333.967468ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52222024-12-21T07:51:23.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52232024-12-21T07:51:23.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52242024-12-21T07:51:23.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52252024-12-21T07:51:23.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52262024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52272024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52282024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52292024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52302024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52312024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52322024-12-21T07:51:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52332024-12-21T07:51:23.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52342024-12-21T07:51:23.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52352024-12-21T07:51:23.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52362024-12-21T07:51:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52372024-12-21T07:51:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52382024-12-21T07:51:23.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52392024-12-21T07:51:23.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52402024-12-21T07:51:23.923ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
52412024-12-21T07:51:23.923ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52422024-12-21T07:51:23.923ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
52432024-12-21T07:51:23.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 343.280708ms iteration = 5 status = {"generation":2}
52442024-12-21T07:51:23.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52452024-12-21T07:51:23.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52462024-12-21T07:51:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52472024-12-21T07:51:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
52482024-12-21T07:51:23.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52492024-12-21T07:51:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52502024-12-21T07:51:23.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 349.297951ms iteration = 9 status = 0
52512024-12-21T07:51:23.932ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
52522024-12-21T07:51:23.932ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 352.448185ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52532024-12-21T07:51:23.934ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52542024-12-21T07:51:23.934ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52552024-12-21T07:51:23.934ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49a89006-c696-4773-977e-47986784b3bd", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52562024-12-21T07:51:23.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52572024-12-21T07:51:23.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52582024-12-21T07:51:23.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52592024-12-21T07:51:23.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52602024-12-21T07:51:23.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52612024-12-21T07:51:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52622024-12-21T07:51:23.943ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52632024-12-21T07:51:23.943ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52642024-12-21T07:51:23.943ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdf2fa75-5182-4d71-bce2-8a42fc00a012", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52652024-12-21T07:51:23.945ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 365.231114ms iteration = 9 status = {}
52662024-12-21T07:51:23.951ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52672024-12-21T07:51:23.951ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52682024-12-21T07:51:23.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52692024-12-21T07:51:23.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52702024-12-21T07:51:23.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
52712024-12-21T07:51:23.966ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52722024-12-21T07:51:23.966ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12fad89e-cf67-4c9a-8752-fe29a237cdd7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52732024-12-21T07:51:23.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52742024-12-21T07:51:23.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
52752024-12-21T07:51:23.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52762024-12-21T07:51:23.968ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52772024-12-21T07:51:23.968ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dce2df72-cdbd-4d9f-9295-99bc65b96730", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52782024-12-21T07:51:23.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52792024-12-21T07:51:23.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52802024-12-21T07:51:23.994ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52812024-12-21T07:51:23.994ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 415.306483ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52822024-12-21T07:51:24.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52832024-12-21T07:51:24.040ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52842024-12-21T07:51:24.040ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "03bc446d-9fca-41ac-9a99-62c244d75216", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
52852024-12-21T07:51:24.040ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52862024-12-21T07:51:24.040ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52872024-12-21T07:51:24.040ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52882024-12-21T07:51:24.041ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 462.089235ms iteration = 9 status = {}
52892024-12-21T07:51:24.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902024-12-21T07:51:24.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52912024-12-21T07:51:24.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52922024-12-21T07:51:24.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52932024-12-21T07:51:24.048ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52942024-12-21T07:51:24.048ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52952024-12-21T07:51:24.048ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
52962024-12-21T07:51:24.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 468.008977ms iteration = 5 status = {"generation":1}
52972024-12-21T07:51:24.066ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52982024-12-21T07:51:24.067ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "491d5550-eba9-4dab-a372-188031cbfb7e", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
52992024-12-21T07:51:24.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53002024-12-21T07:51:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53012024-12-21T07:51:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 490.644485ms iteration = 9 status = null
53022024-12-21T07:51:24.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53032024-12-21T07:51:24.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "38b51a5e-fe90-44d3-92ba-ac30531f450a", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53042024-12-21T07:51:24.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53052024-12-21T07:51:24.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6787a136-6be9-4b7a-8444-eca190e6eb5a", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53062024-12-21T07:51:24.098ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53072024-12-21T07:51:24.100ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "11cbf7a6-383d-4beb-87e9-7956dfe9d4b6", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53082024-12-21T07:51:24.100ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53092024-12-21T07:51:24.102ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53102024-12-21T07:51:24.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 522.292418ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53112024-12-21T07:51:24.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53122024-12-21T07:51:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53132024-12-21T07:51:24.148ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
53142024-12-21T07:51:24.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53152024-12-21T07:51:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53162024-12-21T07:51:24.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53172024-12-21T07:51:24.259ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef140c79-e1fc-4f44-9c5a-b4f2e1db3f60", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
53182024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53192024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
53202024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53212024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53222024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53232024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53242024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53252024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53262024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53272024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53282024-12-21T07:51:24.259ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
53292024-12-21T07:51:24.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53302024-12-21T07:51:24.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53312024-12-21T07:51:24.261ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53322024-12-21T07:51:24.261ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9549b31f-8839-4402-8061-3c7b0437c4ed", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
53332024-12-21T07:51:24.261ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53342024-12-21T07:51:24.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f737bd5-a396-450d-9372-740c6f00f741", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
53352024-12-21T07:51:24.262ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
53362024-12-21T07:51:24.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53372024-12-21T07:51:24.351ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f87818a8-1aa1-4255-b4a0-cb8de495dcb0", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
53382024-12-21T07:51:24.351ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
53392024-12-21T07:51:24.351ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53402024-12-21T07:51:24.351ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b2b5dd-16da-469d-bc0e-77e7433bb5e5", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
53412024-12-21T07:51:24.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53422024-12-21T07:51:24.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53432024-12-21T07:51:24.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53442024-12-21T07:51:24.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53452024-12-21T07:51:24.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53462024-12-21T07:51:24.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53472024-12-21T07:51:24.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53482024-12-21T07:51:24.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53492024-12-21T07:51:24.367ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 787.557779ms iteration = 9 status = {}
53502024-12-21T07:51:24.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 08904c21-f95e-4dc8-ba06-4afe3bd821e4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53512024-12-21T07:51:24.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 08904c21-f95e-4dc8-ba06-4afe3bd821e4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53522024-12-21T07:51:24.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 08904c21-f95e-4dc8-ba06-4afe3bd821e4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53532024-12-21T07:51:25.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a488bc89-ddc0-4376-8289-e0d2b35fdaf3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53542024-12-21T07:51:25.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a488bc89-ddc0-4376-8289-e0d2b35fdaf3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53552024-12-21T07:51:25.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a488bc89-ddc0-4376-8289-e0d2b35fdaf3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53562024-12-21T07:51:25.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 275bff1f-2d0a-4964-aeaf-57c6846ee3b8 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
53572024-12-21T07:51:26.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 757161c9-081f-4fea-b223-5b9a4e91498b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53582024-12-21T07:51:26.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 757161c9-081f-4fea-b223-5b9a4e91498b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53592024-12-21T07:51:26.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 757161c9-081f-4fea-b223-5b9a4e91498b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53602024-12-21T07:51:27.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2687568-902c-4845-8b91-b82214a86efd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53612024-12-21T07:51:27.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2687568-902c-4845-8b91-b82214a86efd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53622024-12-21T07:51:27.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2687568-902c-4845-8b91-b82214a86efd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53632024-12-21T07:51:28.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4679e4e-4f38-41f3-be27-2171df6b245e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53642024-12-21T07:51:28.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4679e4e-4f38-41f3-be27-2171df6b245e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53652024-12-21T07:51:28.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4679e4e-4f38-41f3-be27-2171df6b245e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53662024-12-21T07:51:29.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7da65702-eaae-45f0-be90-7be5b11297c3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53672024-12-21T07:51:29.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7da65702-eaae-45f0-be90-7be5b11297c3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53682024-12-21T07:51:29.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7da65702-eaae-45f0-be90-7be5b11297c3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53692024-12-21T07:51:30.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c0dc0cd-95b6-44ad-a1c1-9eceaf709665 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53702024-12-21T07:51:30.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c0dc0cd-95b6-44ad-a1c1-9eceaf709665 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53712024-12-21T07:51:30.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5c0dc0cd-95b6-44ad-a1c1-9eceaf709665 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53722024-12-21T07:51:31.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23fcb2d1-dfb7-4e67-8b73-b39c5fd3f2bf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53732024-12-21T07:51:31.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23fcb2d1-dfb7-4e67-8b73-b39c5fd3f2bf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53742024-12-21T07:51:31.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23fcb2d1-dfb7-4e67-8b73-b39c5fd3f2bf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53752024-12-21T07:51:32.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1d76558-3271-4a71-bf29-d8637d0eb5e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53762024-12-21T07:51:32.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1d76558-3271-4a71-bf29-d8637d0eb5e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53772024-12-21T07:51:32.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f1d76558-3271-4a71-bf29-d8637d0eb5e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
53782024-12-21T07:51:33.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
53792024-12-21T07:51:33.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
53802024-12-21T07:51:33.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53812024-12-21T07:51:33.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53822024-12-21T07:51:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53832024-12-21T07:51:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53842024-12-21T07:51:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852024-12-21T07:51:33.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53862024-12-21T07:51:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53872024-12-21T07:51:33.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.651073ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53882024-12-21T07:51:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53892024-12-21T07:51:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53902024-12-21T07:51:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53912024-12-21T07:51:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53922024-12-21T07:51:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53932024-12-21T07:51:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-12-21T07:51:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
53952024-12-21T07:51:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53962024-12-21T07:51:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53972024-12-21T07:51:33.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
53982024-12-21T07:51:33.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.037404ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
53992024-12-21T07:51:33.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ec47d087-b9ae-4aad-bea4-e6b74e876050 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54002024-12-21T07:51:33.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ec47d087-b9ae-4aad-bea4-e6b74e876050 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54012024-12-21T07:51:33.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ec47d087-b9ae-4aad-bea4-e6b74e876050 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54022024-12-21T07:51:34.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdec50b1-4f5c-45b8-acee-9f2528100033 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54032024-12-21T07:51:34.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdec50b1-4f5c-45b8-acee-9f2528100033 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54042024-12-21T07:51:34.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdec50b1-4f5c-45b8-acee-9f2528100033 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54052024-12-21T07:51:35.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 114b377e-0a2b-483f-8654-b32b5d428108 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54062024-12-21T07:51:35.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 114b377e-0a2b-483f-8654-b32b5d428108 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54072024-12-21T07:51:35.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 114b377e-0a2b-483f-8654-b32b5d428108 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54082024-12-21T07:51:35.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 28e946ed-23e3-46c0-9c75-399eccd3f8a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
54092024-12-21T07:51:35.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 28e946ed-23e3-46c0-9c75-399eccd3f8a4 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
54102024-12-21T07:51:35.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 28e946ed-23e3-46c0-9c75-399eccd3f8a4 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
54112024-12-21T07:51:35.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = f04a1135-2d16-4ca9-a201-2f7965d89804 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
54122024-12-21T07:51:35.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = f04a1135-2d16-4ca9-a201-2f7965d89804 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
54132024-12-21T07:51:35.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = f04a1135-2d16-4ca9-a201-2f7965d89804 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
54142024-12-21T07:51:35.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 448 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = dc1602cc-bd17-47a0-a5e7-7513e01eb9f9 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
54152024-12-21T07:51:36.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bdaf1c5-2c9b-418b-96a3-a905ee69b6c2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54162024-12-21T07:51:36.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bdaf1c5-2c9b-418b-96a3-a905ee69b6c2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54172024-12-21T07:51:36.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6bdaf1c5-2c9b-418b-96a3-a905ee69b6c2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54182024-12-21T07:51:37.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b4dc28a-094e-4086-9f83-56f339f8b348 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54192024-12-21T07:51:37.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b4dc28a-094e-4086-9f83-56f339f8b348 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54202024-12-21T07:51:37.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b4dc28a-094e-4086-9f83-56f339f8b348 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54212024-12-21T07:51:38.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63d4d293-9273-436a-9707-8bece08e609c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54222024-12-21T07:51:38.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63d4d293-9273-436a-9707-8bece08e609c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54232024-12-21T07:51:38.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63d4d293-9273-436a-9707-8bece08e609c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54242024-12-21T07:51:39.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 169de660-92bd-4838-a799-c0b3e0450b16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54252024-12-21T07:51:39.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 169de660-92bd-4838-a799-c0b3e0450b16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54262024-12-21T07:51:39.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 169de660-92bd-4838-a799-c0b3e0450b16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54272024-12-21T07:51:40.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff9c9135-070b-4433-9c6c-359fdd4363f6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54282024-12-21T07:51:40.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff9c9135-070b-4433-9c6c-359fdd4363f6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54292024-12-21T07:51:40.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff9c9135-070b-4433-9c6c-359fdd4363f6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54302024-12-21T07:51:41.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d8dac38-8695-4bf3-a573-f5bc93cd274d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54312024-12-21T07:51:41.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d8dac38-8695-4bf3-a573-f5bc93cd274d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54322024-12-21T07:51:41.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d8dac38-8695-4bf3-a573-f5bc93cd274d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54332024-12-21T07:51:43.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4befd8b-77c9-4d90-8ce3-90e8bda116dd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54342024-12-21T07:51:43.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4befd8b-77c9-4d90-8ce3-90e8bda116dd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54352024-12-21T07:51:43.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4befd8b-77c9-4d90-8ce3-90e8bda116dd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54362024-12-21T07:51:43.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
54372024-12-21T07:51:43.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
54382024-12-21T07:51:43.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54392024-12-21T07:51:43.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54402024-12-21T07:51:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54412024-12-21T07:51:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54422024-12-21T07:51:43.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54432024-12-21T07:51:43.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-12-21T07:51:43.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452024-12-21T07:51:43.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.723183ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54462024-12-21T07:51:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54472024-12-21T07:51:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54482024-12-21T07:51:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54492024-12-21T07:51:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502024-12-21T07:51:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512024-12-21T07:51:43.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-12-21T07:51:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
54532024-12-21T07:51:43.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54542024-12-21T07:51:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54552024-12-21T07:51:43.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
54562024-12-21T07:51:43.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.535445ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
54572024-12-21T07:51:44.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82451b7b-dd0e-4b89-bcc0-9fcff30ae8af roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54582024-12-21T07:51:44.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82451b7b-dd0e-4b89-bcc0-9fcff30ae8af resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54592024-12-21T07:51:44.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82451b7b-dd0e-4b89-bcc0-9fcff30ae8af response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54602024-12-21T07:51:45.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d36ac87-ad05-4e9e-bf85-288b3dda32df roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54612024-12-21T07:51:45.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d36ac87-ad05-4e9e-bf85-288b3dda32df resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54622024-12-21T07:51:45.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d36ac87-ad05-4e9e-bf85-288b3dda32df response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54632024-12-21T07:51:45.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 825 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = f4d46512-d38f-47ea-aa1f-65cd48800f93 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
54642024-12-21T07:51:46.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcfe2825-ed8d-40da-bcee-cf3cdf467a46 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54652024-12-21T07:51:46.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcfe2825-ed8d-40da-bcee-cf3cdf467a46 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54662024-12-21T07:51:46.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fcfe2825-ed8d-40da-bcee-cf3cdf467a46 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54672024-12-21T07:51:47.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78b03355-6330-4f55-af0a-7120e77a0f1c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54682024-12-21T07:51:47.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78b03355-6330-4f55-af0a-7120e77a0f1c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54692024-12-21T07:51:47.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78b03355-6330-4f55-af0a-7120e77a0f1c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54702024-12-21T07:51:48.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cf2bdfdb-3ae7-4c76-b680-c894179c17fa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54712024-12-21T07:51:48.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cf2bdfdb-3ae7-4c76-b680-c894179c17fa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54722024-12-21T07:51:48.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cf2bdfdb-3ae7-4c76-b680-c894179c17fa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54732024-12-21T07:51:49.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b747ace2-4236-450d-9563-43bc25ef9971 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54742024-12-21T07:51:49.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b747ace2-4236-450d-9563-43bc25ef9971 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54752024-12-21T07:51:49.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b747ace2-4236-450d-9563-43bc25ef9971 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54762024-12-21T07:51:50.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 811c2ba0-f16b-4d31-a8ea-309f7b490112 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54772024-12-21T07:51:50.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 811c2ba0-f16b-4d31-a8ea-309f7b490112 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54782024-12-21T07:51:50.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 811c2ba0-f16b-4d31-a8ea-309f7b490112 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54792024-12-21T07:51:51.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 108e9300-2a84-4862-a27a-03e525167e58 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54802024-12-21T07:51:51.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 108e9300-2a84-4862-a27a-03e525167e58 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54812024-12-21T07:51:51.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 108e9300-2a84-4862-a27a-03e525167e58 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54822024-12-21T07:51:52.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eca9f6b9-8991-48d0-935e-86c7050af9e7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54832024-12-21T07:51:52.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eca9f6b9-8991-48d0-935e-86c7050af9e7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54842024-12-21T07:51:52.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eca9f6b9-8991-48d0-935e-86c7050af9e7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54852024-12-21T07:51:53.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9c89d21-f596-45e2-a323-9783cae3850f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54862024-12-21T07:51:53.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9c89d21-f596-45e2-a323-9783cae3850f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54872024-12-21T07:51:53.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9c89d21-f596-45e2-a323-9783cae3850f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
54882024-12-21T07:51:53.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
54892024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
54902024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54912024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54922024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
54932024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
54942024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54952024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54962024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
54972024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
54982024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54992024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55002024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55012024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55022024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55032024-12-21T07:51:53.580ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55042024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55052024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55062024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55072024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55082024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55092024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55102024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55112024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55122024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55132024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55142024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55152024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55162024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55172024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55182024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55192024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
55202024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55212024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55222024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55232024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55242024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55252024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55262024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55272024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55282024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55292024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55302024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55312024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55322024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55332024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55342024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55352024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55362024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55372024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55382024-12-21T07:51:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55392024-12-21T07:51:53.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 533415072 } })
55402024-12-21T07:51:53.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
55412024-12-21T07:51:53.585ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.126458ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55422024-12-21T07:51:53.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-12-21T07:51:53.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-12-21T07:51:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.41668ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
55452024-12-21T07:51:53.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 538690923 } })
55462024-12-21T07:51:53.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
55472024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55482024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55492024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55502024-12-21T07:51:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55512024-12-21T07:51:53.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55522024-12-21T07:51:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55532024-12-21T07:51:53.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55542024-12-21T07:51:53.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552024-12-21T07:51:53.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55562024-12-21T07:51:53.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55572024-12-21T07:51:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55582024-12-21T07:51:53.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.444247ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
55592024-12-21T07:51:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55602024-12-21T07:51:53.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55612024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55622024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55632024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55642024-12-21T07:51:53.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-12-21T07:51:53.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55662024-12-21T07:51:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55672024-12-21T07:51:53.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55682024-12-21T07:51:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55692024-12-21T07:51:53.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55702024-12-21T07:51:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55712024-12-21T07:51:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55722024-12-21T07:51:53.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55732024-12-21T07:51:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55742024-12-21T07:51:53.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55752024-12-21T07:51:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55762024-12-21T07:51:53.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55772024-12-21T07:51:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55782024-12-21T07:51:53.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55792024-12-21T07:51:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55802024-12-21T07:51:53.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55812024-12-21T07:51:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55822024-12-21T07:51:53.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832024-12-21T07:51:53.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 32.297964ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55842024-12-21T07:51:53.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852024-12-21T07:51:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55862024-12-21T07:51:53.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55872024-12-21T07:51:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55882024-12-21T07:51:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
55892024-12-21T07:51:53.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902024-12-21T07:51:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55912024-12-21T07:51:53.619ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55922024-12-21T07:51:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 39.691901ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55932024-12-21T07:51:53.647ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
55942024-12-21T07:51:53.647ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.569949ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
55952024-12-21T07:51:53.657ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55962024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55972024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55982024-12-21T07:51:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55992024-12-21T07:51:53.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56002024-12-21T07:51:53.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56012024-12-21T07:51:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56022024-12-21T07:51:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56032024-12-21T07:51:53.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56042024-12-21T07:51:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56052024-12-21T07:51:53.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.193537ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56062024-12-21T07:51:53.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56072024-12-21T07:51:53.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56082024-12-21T07:51:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56092024-12-21T07:51:53.666ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 617382912 } })
56102024-12-21T07:51:53.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56112024-12-21T07:51:53.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56122024-12-21T07:51:53.667ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
56132024-12-21T07:51:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56142024-12-21T07:51:53.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56152024-12-21T07:51:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56162024-12-21T07:51:53.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56172024-12-21T07:51:53.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.3152ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56182024-12-21T07:51:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.646062ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56192024-12-21T07:51:53.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
56202024-12-21T07:51:53.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56212024-12-21T07:51:53.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56222024-12-21T07:51:53.675ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.644651ms iteration = 10 status = 0
56232024-12-21T07:51:53.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56242024-12-21T07:51:53.676ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56252024-12-21T07:51:53.676ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea444e95-3b99-4a64-a146-e0635bece427", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56262024-12-21T07:51:53.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56272024-12-21T07:51:53.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56282024-12-21T07:51:53.678ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56292024-12-21T07:51:53.678ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1137b135-21b9-4ad6-b060-4d50f6b4348e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56302024-12-21T07:51:53.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56312024-12-21T07:51:53.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56322024-12-21T07:51:53.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56332024-12-21T07:51:53.691ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.439631ms iteration = 12 status = {"physical_disks_added":0}
56342024-12-21T07:51:53.699ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56352024-12-21T07:51:53.699ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56362024-12-21T07:51:53.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56372024-12-21T07:51:53.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56382024-12-21T07:51:53.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56392024-12-21T07:51:53.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56402024-12-21T07:51:53.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.335358ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56412024-12-21T07:51:53.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
56422024-12-21T07:51:53.746ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56432024-12-21T07:51:53.746ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d7ca3f-2d63-4fcd-b434-20c32b87860c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56442024-12-21T07:51:53.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56452024-12-21T07:51:53.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
56462024-12-21T07:51:53.752ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56472024-12-21T07:51:53.752ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f37fae7a-656c-49f8-8e72-4cbaba513b9f", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56482024-12-21T07:51:53.754ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56492024-12-21T07:51:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56502024-12-21T07:51:53.756ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 176.773592ms iteration = 10 status = null
56512024-12-21T07:51:53.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56522024-12-21T07:51:53.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56532024-12-21T07:51:53.761ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.565464ms iteration = 10 status = {}
56542024-12-21T07:51:53.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56552024-12-21T07:51:53.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56562024-12-21T07:51:53.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56572024-12-21T07:51:53.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56582024-12-21T07:51:53.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56592024-12-21T07:51:53.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56602024-12-21T07:51:53.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56612024-12-21T07:51:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56622024-12-21T07:51:53.826ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56632024-12-21T07:51:53.826ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56642024-12-21T07:51:53.903ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56652024-12-21T07:51:53.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56662024-12-21T07:51:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56672024-12-21T07:51:53.916ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
56682024-12-21T07:51:53.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56692024-12-21T07:51:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56702024-12-21T07:51:53.924ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56712024-12-21T07:51:53.924ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4c362ec-24c2-4a38-81a8-ca0f991b3df4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56722024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56732024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
56742024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56752024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56762024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56772024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56782024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56792024-12-21T07:51:53.924ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56802024-12-21T07:51:53.925ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56812024-12-21T07:51:53.925ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56822024-12-21T07:51:53.925ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
56832024-12-21T07:51:53.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56842024-12-21T07:51:53.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56852024-12-21T07:51:53.926ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4fc84e7-7a17-4588-9828-bc053a99e5bc", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56862024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56872024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56882024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56892024-12-21T07:51:53.926ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "504e0eb2-1fbc-42a0-aeee-b8fb559cbe40", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56902024-12-21T07:51:53.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56912024-12-21T07:51:53.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56922024-12-21T07:51:53.927ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.910197ms iteration = 10 status = {}
56932024-12-21T07:51:53.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56942024-12-21T07:51:53.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2bbd1b-651e-4629-a60b-0e4284580976", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56952024-12-21T07:51:53.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56962024-12-21T07:51:53.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f3146b5-aa46-43ce-8ba9-8929ca2d4755", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
56972024-12-21T07:51:53.928ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
56982024-12-21T07:51:53.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56992024-12-21T07:51:53.970ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57002024-12-21T07:51:53.970ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57012024-12-21T07:51:53.970ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "42415972-1b58-41c2-9784-2356d7b19a87", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
57022024-12-21T07:51:53.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57032024-12-21T07:51:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57042024-12-21T07:51:53.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57052024-12-21T07:51:53.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57062024-12-21T07:51:53.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57072024-12-21T07:51:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57082024-12-21T07:51:53.979ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57092024-12-21T07:51:53.979ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57102024-12-21T07:51:53.979ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b64940c-934c-492a-8475-201bb89f85b4", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
57112024-12-21T07:51:53.980ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.837075ms iteration = 10 status = {}
57122024-12-21T07:51:54.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0b51c4cb-21c7-4999-a5b2-042893c62ad6", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
57132024-12-21T07:51:54.109ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
57142024-12-21T07:51:54.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57152024-12-21T07:51:54.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f37ba083-af32-486c-83a6-faec7f736ea4", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
57162024-12-21T07:51:54.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57172024-12-21T07:51:54.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57182024-12-21T07:51:54.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57192024-12-21T07:51:54.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57202024-12-21T07:51:54.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57212024-12-21T07:51:54.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57222024-12-21T07:51:54.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57232024-12-21T07:51:54.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57242024-12-21T07:51:54.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.550527ms iteration = 10 status = {}
57252024-12-21T07:51:54.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5b538670-470b-420e-9184-25c58bcbecf6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57262024-12-21T07:51:54.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5b538670-470b-420e-9184-25c58bcbecf6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57272024-12-21T07:51:54.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5b538670-470b-420e-9184-25c58bcbecf6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57282024-12-21T07:51:55.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 707f4db0-ad5a-4c21-b527-b227239a9edb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57292024-12-21T07:51:55.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 707f4db0-ad5a-4c21-b527-b227239a9edb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57302024-12-21T07:51:55.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 707f4db0-ad5a-4c21-b527-b227239a9edb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57312024-12-21T07:51:55.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = aa54877e-dc84-43a2-a3e6-f6671cd68db2 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
57322024-12-21T07:51:56.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ca7afab-e9a8-4472-b03a-013ba0a395cd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57332024-12-21T07:51:56.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ca7afab-e9a8-4472-b03a-013ba0a395cd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57342024-12-21T07:51:56.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ca7afab-e9a8-4472-b03a-013ba0a395cd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57352024-12-21T07:51:57.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5681cf01-6db2-455d-b102-fab21f0895b5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57362024-12-21T07:51:57.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5681cf01-6db2-455d-b102-fab21f0895b5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57372024-12-21T07:51:57.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5681cf01-6db2-455d-b102-fab21f0895b5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57382024-12-21T07:51:58.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b68a3016-bf66-4c3b-a8a9-f8758c8c5584 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57392024-12-21T07:51:58.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b68a3016-bf66-4c3b-a8a9-f8758c8c5584 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57402024-12-21T07:51:58.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b68a3016-bf66-4c3b-a8a9-f8758c8c5584 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57412024-12-21T07:51:59.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7342221-f65e-42db-8ef6-8f664e4e649d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57422024-12-21T07:51:59.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7342221-f65e-42db-8ef6-8f664e4e649d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57432024-12-21T07:51:59.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7342221-f65e-42db-8ef6-8f664e4e649d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57442024-12-21T07:52:00.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 612ee07a-fbd7-4864-b34b-5f6875d692fa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57452024-12-21T07:52:00.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 612ee07a-fbd7-4864-b34b-5f6875d692fa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57462024-12-21T07:52:00.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 612ee07a-fbd7-4864-b34b-5f6875d692fa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57472024-12-21T07:52:01.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d65f5aee-90b1-4f09-bf57-b38a98eb87eb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57482024-12-21T07:52:01.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d65f5aee-90b1-4f09-bf57-b38a98eb87eb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57492024-12-21T07:52:01.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d65f5aee-90b1-4f09-bf57-b38a98eb87eb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57502024-12-21T07:52:02.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 128fc4b5-eccb-4a36-98b4-67e6846e9490 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57512024-12-21T07:52:02.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 128fc4b5-eccb-4a36-98b4-67e6846e9490 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57522024-12-21T07:52:02.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 128fc4b5-eccb-4a36-98b4-67e6846e9490 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57532024-12-21T07:52:03.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a71f08-6970-4ee1-a112-919dad761d0b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57542024-12-21T07:52:03.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a71f08-6970-4ee1-a112-919dad761d0b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57552024-12-21T07:52:03.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a71f08-6970-4ee1-a112-919dad761d0b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57562024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
57572024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
57582024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57592024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57602024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612024-12-21T07:52:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57622024-12-21T07:52:03.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57632024-12-21T07:52:03.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57642024-12-21T07:52:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57652024-12-21T07:52:03.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.944168ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57662024-12-21T07:52:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57672024-12-21T07:52:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682024-12-21T07:52:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57692024-12-21T07:52:03.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57702024-12-21T07:52:03.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57712024-12-21T07:52:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57722024-12-21T07:52:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
57732024-12-21T07:52:03.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57742024-12-21T07:52:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57752024-12-21T07:52:03.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
57762024-12-21T07:52:03.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.381906ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
57772024-12-21T07:52:04.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38212596-616a-4646-b757-8f6e1c6fae5c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57782024-12-21T07:52:04.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38212596-616a-4646-b757-8f6e1c6fae5c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57792024-12-21T07:52:04.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38212596-616a-4646-b757-8f6e1c6fae5c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57802024-12-21T07:52:05.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c9ba936-9abd-467a-848f-eb91b1c8eb6e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57812024-12-21T07:52:05.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c9ba936-9abd-467a-848f-eb91b1c8eb6e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57822024-12-21T07:52:05.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c9ba936-9abd-467a-848f-eb91b1c8eb6e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57832024-12-21T07:52:05.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 905357b1-74f6-43c4-9ddd-cf7fac42e5ea roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
57842024-12-21T07:52:05.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 905357b1-74f6-43c4-9ddd-cf7fac42e5ea resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
57852024-12-21T07:52:05.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 905357b1-74f6-43c4-9ddd-cf7fac42e5ea response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
57862024-12-21T07:52:05.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3b341b4e-429c-482f-93d0-b099c46160f5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
57872024-12-21T07:52:05.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3b341b4e-429c-482f-93d0-b099c46160f5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
57882024-12-21T07:52:05.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64612 req_id = 3b341b4e-429c-482f-93d0-b099c46160f5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
57892024-12-21T07:52:05.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 450 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = a8240394-d503-4946-ace7-c1f7bf426730 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
57902024-12-21T07:52:06.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c5c12d2-b758-4c72-90ca-292fb1c4c8ac roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57912024-12-21T07:52:06.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c5c12d2-b758-4c72-90ca-292fb1c4c8ac resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57922024-12-21T07:52:06.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c5c12d2-b758-4c72-90ca-292fb1c4c8ac response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57932024-12-21T07:52:07.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e5cbab5-eac6-4f3c-8970-7768b2070995 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57942024-12-21T07:52:07.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e5cbab5-eac6-4f3c-8970-7768b2070995 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57952024-12-21T07:52:07.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3e5cbab5-eac6-4f3c-8970-7768b2070995 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57962024-12-21T07:52:08.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2a146699-b769-4574-b3cc-85085b25d89a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57972024-12-21T07:52:08.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2a146699-b769-4574-b3cc-85085b25d89a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57982024-12-21T07:52:08.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2a146699-b769-4574-b3cc-85085b25d89a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
57992024-12-21T07:52:09.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50b13eb8-4eef-46f0-b8b5-8a2513248b8c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58002024-12-21T07:52:09.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50b13eb8-4eef-46f0-b8b5-8a2513248b8c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58012024-12-21T07:52:09.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50b13eb8-4eef-46f0-b8b5-8a2513248b8c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58022024-12-21T07:52:10.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d62e1453-6799-4820-a3fd-6359ad00f5e4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58032024-12-21T07:52:10.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d62e1453-6799-4820-a3fd-6359ad00f5e4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58042024-12-21T07:52:10.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d62e1453-6799-4820-a3fd-6359ad00f5e4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58052024-12-21T07:52:11.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644d5561-1346-45fa-aa20-91e8890ccf66 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58062024-12-21T07:52:11.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644d5561-1346-45fa-aa20-91e8890ccf66 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58072024-12-21T07:52:11.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644d5561-1346-45fa-aa20-91e8890ccf66 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58082024-12-21T07:52:12.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a1ae6db-e4c8-4cb3-ae1f-ae265810b5e6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58092024-12-21T07:52:12.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a1ae6db-e4c8-4cb3-ae1f-ae265810b5e6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58102024-12-21T07:52:12.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a1ae6db-e4c8-4cb3-ae1f-ae265810b5e6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58112024-12-21T07:52:13.579ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58122024-12-21T07:52:13.579ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58132024-12-21T07:52:13.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58142024-12-21T07:52:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58152024-12-21T07:52:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58162024-12-21T07:52:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58172024-12-21T07:52:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58182024-12-21T07:52:13.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58192024-12-21T07:52:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58202024-12-21T07:52:13.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.361998ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58212024-12-21T07:52:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58222024-12-21T07:52:13.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58232024-12-21T07:52:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58242024-12-21T07:52:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58252024-12-21T07:52:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58262024-12-21T07:52:13.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-12-21T07:52:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
58282024-12-21T07:52:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58292024-12-21T07:52:13.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58302024-12-21T07:52:13.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
58312024-12-21T07:52:13.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.58482ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
58322024-12-21T07:52:13.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1996cd75-591c-496d-9652-60a7ba572bc0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58332024-12-21T07:52:13.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1996cd75-591c-496d-9652-60a7ba572bc0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58342024-12-21T07:52:13.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1996cd75-591c-496d-9652-60a7ba572bc0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58352024-12-21T07:52:14.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a38117e-537b-4c00-896e-1476a2eeed3a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58362024-12-21T07:52:14.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a38117e-537b-4c00-896e-1476a2eeed3a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58372024-12-21T07:52:14.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a38117e-537b-4c00-896e-1476a2eeed3a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58382024-12-21T07:52:15.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3fcb796f-1bb3-411f-87a3-bfc916a3e16d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58392024-12-21T07:52:15.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3fcb796f-1bb3-411f-87a3-bfc916a3e16d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58402024-12-21T07:52:15.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3fcb796f-1bb3-411f-87a3-bfc916a3e16d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58412024-12-21T07:52:15.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 601 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = a9ef9655-0777-456a-93e0-261a34586134 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
58422024-12-21T07:52:16.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2648f8f4-1988-49eb-a786-ba8b169242da roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58432024-12-21T07:52:16.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2648f8f4-1988-49eb-a786-ba8b169242da resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58442024-12-21T07:52:16.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2648f8f4-1988-49eb-a786-ba8b169242da response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58452024-12-21T07:52:17.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2d266b6-a9df-4ff9-ad7c-c98def5b2303 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58462024-12-21T07:52:17.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2d266b6-a9df-4ff9-ad7c-c98def5b2303 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58472024-12-21T07:52:17.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2d266b6-a9df-4ff9-ad7c-c98def5b2303 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58482024-12-21T07:52:18.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c6e4b70c-7731-4065-b97b-1a95de393a31 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58492024-12-21T07:52:18.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c6e4b70c-7731-4065-b97b-1a95de393a31 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58502024-12-21T07:52:18.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c6e4b70c-7731-4065-b97b-1a95de393a31 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58512024-12-21T07:52:19.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e82a34b-00e4-4528-a471-9055b3ec0952 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58522024-12-21T07:52:19.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e82a34b-00e4-4528-a471-9055b3ec0952 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58532024-12-21T07:52:19.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e82a34b-00e4-4528-a471-9055b3ec0952 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58542024-12-21T07:52:20.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47deccfa-9593-4dfc-adcc-3e5440578c18 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58552024-12-21T07:52:20.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47deccfa-9593-4dfc-adcc-3e5440578c18 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58562024-12-21T07:52:20.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47deccfa-9593-4dfc-adcc-3e5440578c18 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58572024-12-21T07:52:21.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5949cae2-73d1-45ec-9186-d65317ecf186 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58582024-12-21T07:52:21.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5949cae2-73d1-45ec-9186-d65317ecf186 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58592024-12-21T07:52:21.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5949cae2-73d1-45ec-9186-d65317ecf186 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58602024-12-21T07:52:22.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d7157b4-b8bf-4156-8c4a-5685dbc0af39 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58612024-12-21T07:52:22.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d7157b4-b8bf-4156-8c4a-5685dbc0af39 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58622024-12-21T07:52:22.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d7157b4-b8bf-4156-8c4a-5685dbc0af39 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
58632024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
58642024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
58652024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58662024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58672024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
58682024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
58692024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58702024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58712024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
58722024-12-21T07:52:23.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:42:23.580928916 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58732024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58742024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
58752024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58762024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
58772024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58782024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
58792024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
58802024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58812024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
58822024-12-21T07:52:23.581ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58832024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58842024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
58852024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
58862024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
58872024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58882024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58892024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
58902024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58912024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
58922024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58932024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
58942024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58952024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58962024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
58972024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58982024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
58992024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59002024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59012024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59022024-12-21T07:52:23.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59032024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59042024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
59052024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
59062024-12-21T07:52:23.581ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
59072024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59082024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59092024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59102024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59112024-12-21T07:52:23.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
59122024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.35\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
59132024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59142024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
59152024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59162024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59172024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59182024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59192024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
59202024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59212024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59222024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59232024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59242024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
59252024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59262024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59272024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
59282024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59292024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59302024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59312024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59322024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59332024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59342024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
59352024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59362024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59372024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59382024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59392024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59402024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59412024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59422024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59432024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59442024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59452024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59462024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59472024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59482024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59492024-12-21T07:52:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 532528267 } })
59502024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59512024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59522024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59532024-12-21T07:52:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 532643309 } })
59542024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59552024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
59562024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.306332ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
59572024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
59582024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.582417ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
59592024-12-21T07:52:23.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 536732219 } })
59602024-12-21T07:52:23.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
59612024-12-21T07:52:23.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59622024-12-21T07:52:23.588ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:42:23.580928916 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59632024-12-21T07:52:23.588ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.669692ms iteration = 6 status = {"expiration":"2024-12-21T07:42:23.580928916Z","pruned":[]}
59642024-12-21T07:52:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59652024-12-21T07:52:23.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662024-12-21T07:52:23.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672024-12-21T07:52:23.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59682024-12-21T07:52:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59692024-12-21T07:52:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59702024-12-21T07:52:23.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59712024-12-21T07:52:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59722024-12-21T07:52:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.083184ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59732024-12-21T07:52:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59742024-12-21T07:52:23.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59752024-12-21T07:52:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59762024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59772024-12-21T07:52:23.597ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59782024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.034735ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59792024-12-21T07:52:23.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59802024-12-21T07:52:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59812024-12-21T07:52:23.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59822024-12-21T07:52:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59832024-12-21T07:52:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.784277ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
59842024-12-21T07:52:23.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59852024-12-21T07:52:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59862024-12-21T07:52:23.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59872024-12-21T07:52:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59882024-12-21T07:52:23.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 558876429 } })
59892024-12-21T07:52:23.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
59902024-12-21T07:52:23.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59912024-12-21T07:52:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59922024-12-21T07:52:23.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-12-21T07:52:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59942024-12-21T07:52:23.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59952024-12-21T07:52:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59962024-12-21T07:52:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-12-21T07:52:23.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59982024-12-21T07:52:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59992024-12-21T07:52:23.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002024-12-21T07:52:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60012024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60022024-12-21T07:52:23.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60032024-12-21T07:52:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60042024-12-21T07:52:23.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60052024-12-21T07:52:23.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60062024-12-21T07:52:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60072024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60082024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60092024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60102024-12-21T07:52:23.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60112024-12-21T07:52:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60122024-12-21T07:52:23.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60132024-12-21T07:52:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60142024-12-21T07:52:23.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60152024-12-21T07:52:23.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 579549043 } })
60162024-12-21T07:52:23.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
60172024-12-21T07:52:23.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60182024-12-21T07:52:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60192024-12-21T07:52:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60202024-12-21T07:52:23.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60212024-12-21T07:52:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60222024-12-21T07:52:23.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60232024-12-21T07:52:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60242024-12-21T07:52:23.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60252024-12-21T07:52:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60262024-12-21T07:52:23.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60272024-12-21T07:52:23.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60282024-12-21T07:52:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60292024-12-21T07:52:23.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60302024-12-21T07:52:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
60312024-12-21T07:52:23.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60322024-12-21T07:52:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60332024-12-21T07:52:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60342024-12-21T07:52:23.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60352024-12-21T07:52:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60362024-12-21T07:52:23.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60372024-12-21T07:52:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60382024-12-21T07:52:23.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.104175ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
60392024-12-21T07:52:23.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-12-21T07:52:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.35705ms iteration = 13 status = {"physical_disks_added":0}
60412024-12-21T07:52:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60422024-12-21T07:52:23.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60432024-12-21T07:52:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60442024-12-21T07:52:23.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60452024-12-21T07:52:23.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60462024-12-21T07:52:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60472024-12-21T07:52:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60482024-12-21T07:52:23.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60492024-12-21T07:52:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60502024-12-21T07:52:23.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60512024-12-21T07:52:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60522024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60532024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60542024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60552024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60572024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60582024-12-21T07:52:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60592024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60602024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60612024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60622024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60632024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60642024-12-21T07:52:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60652024-12-21T07:52:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60662024-12-21T07:52:23.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60672024-12-21T07:52:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60682024-12-21T07:52:23.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
60692024-12-21T07:52:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.284807ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
60702024-12-21T07:52:23.683ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60712024-12-21T07:52:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60722024-12-21T07:52:23.684ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60732024-12-21T07:52:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.857151ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60742024-12-21T07:52:23.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.25652ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60752024-12-21T07:52:23.689ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60762024-12-21T07:52:23.689ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60772024-12-21T07:52:23.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60782024-12-21T07:52:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60792024-12-21T07:52:23.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60802024-12-21T07:52:23.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60812024-12-21T07:52:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 111.826228ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
60822024-12-21T07:52:23.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60832024-12-21T07:52:23.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60842024-12-21T07:52:23.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60852024-12-21T07:52:23.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60862024-12-21T07:52:23.695ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60872024-12-21T07:52:23.695ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60882024-12-21T07:52:23.695ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60892024-12-21T07:52:23.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60902024-12-21T07:52:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60912024-12-21T07:52:23.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60922024-12-21T07:52:23.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60932024-12-21T07:52:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60942024-12-21T07:52:23.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60952024-12-21T07:52:23.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60962024-12-21T07:52:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60972024-12-21T07:52:23.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982024-12-21T07:52:23.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60992024-12-21T07:52:23.702ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61002024-12-21T07:52:23.702ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61012024-12-21T07:52:23.702ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61022024-12-21T07:52:23.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61032024-12-21T07:52:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61042024-12-21T07:52:23.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61052024-12-21T07:52:23.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61062024-12-21T07:52:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61072024-12-21T07:52:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61082024-12-21T07:52:23.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61092024-12-21T07:52:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61102024-12-21T07:52:23.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.141681ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61112024-12-21T07:52:23.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122024-12-21T07:52:23.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61132024-12-21T07:52:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61142024-12-21T07:52:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61152024-12-21T07:52:23.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61162024-12-21T07:52:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61172024-12-21T07:52:23.728ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61182024-12-21T07:52:23.728ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61192024-12-21T07:52:23.728ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 146.814309ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61202024-12-21T07:52:23.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.767152ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61212024-12-21T07:52:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.091735ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61222024-12-21T07:52:23.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61232024-12-21T07:52:23.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61242024-12-21T07:52:23.736ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
61252024-12-21T07:52:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 155.203742ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61262024-12-21T07:52:23.742ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61272024-12-21T07:52:23.742ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61282024-12-21T07:52:23.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61292024-12-21T07:52:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61302024-12-21T07:52:23.759ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61312024-12-21T07:52:23.759ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 178.476501ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61322024-12-21T07:52:23.792ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61332024-12-21T07:52:23.792ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61342024-12-21T07:52:23.792ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59d7ff22-c745-498a-a128-73e7c361289b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
61352024-12-21T07:52:23.792ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61362024-12-21T07:52:23.794ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61372024-12-21T07:52:23.796ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61382024-12-21T07:52:23.796ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61392024-12-21T07:52:23.796ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "228f771d-d4a8-4a24-991e-674d26d6263c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
61402024-12-21T07:52:23.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61412024-12-21T07:52:23.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61422024-12-21T07:52:23.828ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
61432024-12-21T07:52:23.828ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61442024-12-21T07:52:23.829ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a396524-9730-46ae-ab1f-488c1e56a154", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
61452024-12-21T07:52:23.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61462024-12-21T07:52:23.831ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
61472024-12-21T07:52:23.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e5eb556c-95e3-46d1-9076-a836dada3c00 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
61482024-12-21T07:52:23.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e5eb556c-95e3-46d1-9076-a836dada3c00 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
61492024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61502024-12-21T07:52:23.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61512024-12-21T07:52:23.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e3c93c35-3a28-4999-98d8-68cc6af53690", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61522024-12-21T07:52:23.909ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61532024-12-21T07:52:23.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ccac3f7b-3163-47e1-9828-c8fefe190874", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61542024-12-21T07:52:23.911ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61552024-12-21T07:52:23.912ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61562024-12-21T07:52:23.912ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.75499ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61572024-12-21T07:52:23.936ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61582024-12-21T07:52:23.936ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61592024-12-21T07:52:23.936ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6843bf4f-37d6-4eb4-9b83-3d4c11be255f", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
61602024-12-21T07:52:23.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61612024-12-21T07:52:23.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61622024-12-21T07:52:23.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-12-21T07:52:23.941ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61642024-12-21T07:52:23.941ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
61652024-12-21T07:52:23.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61662024-12-21T07:52:23.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61672024-12-21T07:52:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61682024-12-21T07:52:23.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61692024-12-21T07:52:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61702024-12-21T07:52:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61712024-12-21T07:52:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61722024-12-21T07:52:23.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e5eb556c-95e3-46d1-9076-a836dada3c00 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
61732024-12-21T07:52:23.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61742024-12-21T07:52:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61752024-12-21T07:52:23.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762024-12-21T07:52:23.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61772024-12-21T07:52:23.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61782024-12-21T07:52:23.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61792024-12-21T07:52:23.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61802024-12-21T07:52:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
61812024-12-21T07:52:23.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61822024-12-21T07:52:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61832024-12-21T07:52:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61842024-12-21T07:52:23.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61852024-12-21T07:52:23.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61862024-12-21T07:52:23.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61872024-12-21T07:52:23.953ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 371.97574ms iteration = 11 status = 0
61882024-12-21T07:52:23.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61892024-12-21T07:52:23.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61902024-12-21T07:52:23.957ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
61912024-12-21T07:52:23.957ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61922024-12-21T07:52:23.957ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
61932024-12-21T07:52:23.957ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 376.316014ms iteration = 6 status = {"generation":2}
61942024-12-21T07:52:23.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61952024-12-21T07:52:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61962024-12-21T07:52:23.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61972024-12-21T07:52:23.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61982024-12-21T07:52:23.971ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.967399ms iteration = 11 status = {}
61992024-12-21T07:52:23.984ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62002024-12-21T07:52:23.984ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62012024-12-21T07:52:23.984ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 402.965242ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62022024-12-21T07:52:23.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62032024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62042024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62052024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62062024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62072024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62082024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62092024-12-21T07:52:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62102024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62112024-12-21T07:52:23.999ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62122024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62132024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62142024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2060cbac-26b5-4d48-89cc-374903735f70", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
62152024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62162024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62172024-12-21T07:52:23.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62182024-12-21T07:52:24.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62192024-12-21T07:52:24.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62202024-12-21T07:52:24.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62212024-12-21T07:52:24.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62222024-12-21T07:52:24.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62232024-12-21T07:52:24.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62242024-12-21T07:52:24.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62252024-12-21T07:52:24.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62262024-12-21T07:52:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62272024-12-21T07:52:24.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62282024-12-21T07:52:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62292024-12-21T07:52:24.005ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62302024-12-21T07:52:24.005ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62312024-12-21T07:52:24.005ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
62322024-12-21T07:52:24.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 424.253416ms iteration = 6 status = {"generation":1}
62332024-12-21T07:52:24.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62342024-12-21T07:52:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62352024-12-21T07:52:24.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62362024-12-21T07:52:24.007ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62372024-12-21T07:52:24.007ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62382024-12-21T07:52:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62392024-12-21T07:52:24.008ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae788e15-9df9-4ac7-b1e8-0051666e4101", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
62402024-12-21T07:52:24.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62412024-12-21T07:52:24.009ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 428.367407ms iteration = 11 status = {}
62422024-12-21T07:52:24.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62432024-12-21T07:52:24.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442024-12-21T07:52:24.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62452024-12-21T07:52:24.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62462024-12-21T07:52:24.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62472024-12-21T07:52:24.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62482024-12-21T07:52:24.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62492024-12-21T07:52:24.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62502024-12-21T07:52:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62512024-12-21T07:52:24.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62522024-12-21T07:52:24.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62532024-12-21T07:52:24.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62542024-12-21T07:52:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62552024-12-21T07:52:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62562024-12-21T07:52:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62572024-12-21T07:52:24.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62582024-12-21T07:52:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62592024-12-21T07:52:24.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62602024-12-21T07:52:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62612024-12-21T07:52:24.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62622024-12-21T07:52:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62632024-12-21T07:52:24.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62642024-12-21T07:52:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62652024-12-21T07:52:24.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62662024-12-21T07:52:24.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0412d777-a601-466a-984b-2588ad0e3f53", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62672024-12-21T07:52:24.040ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62682024-12-21T07:52:24.042ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5f3ee62d-7a7d-4977-940e-0d0f6dfcbcf9", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62692024-12-21T07:52:24.042ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62702024-12-21T07:52:24.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b3822f51-6484-4acf-974a-2e035d40930c", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62712024-12-21T07:52:24.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62722024-12-21T07:52:24.044ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62732024-12-21T07:52:24.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf02bb09-40c6-40e1-b247-249ae0f4a37f", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
62742024-12-21T07:52:24.045ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
62752024-12-21T07:52:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 464.195572ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62762024-12-21T07:52:24.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62772024-12-21T07:52:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62782024-12-21T07:52:24.096ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62792024-12-21T07:52:24.097ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "467444fe-f689-48ea-87e0-d04bd17f3506", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
62802024-12-21T07:52:24.097ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62812024-12-21T07:52:24.097ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62822024-12-21T07:52:24.097ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62832024-12-21T07:52:24.098ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 517.427965ms iteration = 11 status = {}
62842024-12-21T07:52:24.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62852024-12-21T07:52:24.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62862024-12-21T07:52:24.099ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.30616ms iteration = 11 status = null
62872024-12-21T07:52:24.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62882024-12-21T07:52:24.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62892024-12-21T07:52:24.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62902024-12-21T07:52:24.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62912024-12-21T07:52:24.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62922024-12-21T07:52:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62932024-12-21T07:52:24.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62942024-12-21T07:52:24.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62952024-12-21T07:52:24.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62962024-12-21T07:52:24.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62972024-12-21T07:52:24.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62982024-12-21T07:52:24.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62992024-12-21T07:52:24.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63002024-12-21T07:52:24.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63012024-12-21T07:52:24.126ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
63022024-12-21T07:52:24.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63032024-12-21T07:52:24.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63042024-12-21T07:52:24.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052024-12-21T07:52:24.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63062024-12-21T07:52:24.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63072024-12-21T07:52:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63082024-12-21T07:52:24.132ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
63092024-12-21T07:52:24.132ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
63102024-12-21T07:52:24.132ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
63112024-12-21T07:52:24.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63122024-12-21T07:52:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63132024-12-21T07:52:24.148ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
63142024-12-21T07:52:24.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-12-21T07:52:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-12-21T07:52:24.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63172024-12-21T07:52:24.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e456103-ec53-43ea-a547-940de983c079", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
63182024-12-21T07:52:24.158ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63192024-12-21T07:52:24.158ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
63202024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63212024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63222024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63232024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63242024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63252024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63262024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63272024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63282024-12-21T07:52:24.159ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
63292024-12-21T07:52:24.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63302024-12-21T07:52:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63312024-12-21T07:52:24.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63322024-12-21T07:52:24.161ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b64f89da-4b14-4d58-803f-e2cc4700c547", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
63332024-12-21T07:52:24.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63342024-12-21T07:52:24.161ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ab6c06a-f6a1-43b8-9f57-a7f2eabe8cbc", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
63352024-12-21T07:52:24.161ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
63362024-12-21T07:52:24.161ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63372024-12-21T07:52:24.212ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
63382024-12-21T07:52:24.212ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
63392024-12-21T07:52:24.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63402024-12-21T07:52:24.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63412024-12-21T07:52:24.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63422024-12-21T07:52:24.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63432024-12-21T07:52:24.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-12-21T07:52:24.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
63452024-12-21T07:52:24.251ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
63462024-12-21T07:52:24.251ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "002cc212-465d-4225-90fe-6f06b3a3d393", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} })
63472024-12-21T07:52:24.253ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
63482024-12-21T07:52:24.253ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 672.490545ms
63492024-12-21T07:52:24.253ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 672.501395ms iteration = 2 status = {}
63502024-12-21T07:52:24.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b683114e-ac4e-45ee-8803-fc6c158f85d7", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} })
63512024-12-21T07:52:24.414ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
63522024-12-21T07:52:24.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63532024-12-21T07:52:24.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a03d13d-fe0a-4eff-9d9b-a550731b07b9", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} })
63542024-12-21T07:52:24.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63552024-12-21T07:52:24.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63562024-12-21T07:52:24.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63572024-12-21T07:52:24.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63582024-12-21T07:52:24.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63592024-12-21T07:52:24.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63602024-12-21T07:52:24.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63612024-12-21T07:52:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63622024-12-21T07:52:24.430ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 849.780546ms iteration = 11 status = {}
63632024-12-21T07:52:24.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ce9e631-78ca-4c12-aef8-6ca2220d22d9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63642024-12-21T07:52:24.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ce9e631-78ca-4c12-aef8-6ca2220d22d9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63652024-12-21T07:52:24.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ce9e631-78ca-4c12-aef8-6ca2220d22d9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63662024-12-21T07:52:25.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 8b6713ec-e6bd-4968-b3e5-ad918b47eae5 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
63672024-12-21T07:52:25.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c7680be-7712-4cca-9fa1-97094df07e23 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63682024-12-21T07:52:25.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c7680be-7712-4cca-9fa1-97094df07e23 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63692024-12-21T07:52:25.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7c7680be-7712-4cca-9fa1-97094df07e23 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63702024-12-21T07:52:27.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f1d6c8f-49c5-4c90-999b-219405b34b0a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63712024-12-21T07:52:27.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f1d6c8f-49c5-4c90-999b-219405b34b0a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63722024-12-21T07:52:27.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f1d6c8f-49c5-4c90-999b-219405b34b0a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63732024-12-21T07:52:28.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34cf552c-d94b-4ce4-8fb4-11ca93cbe930 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63742024-12-21T07:52:28.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34cf552c-d94b-4ce4-8fb4-11ca93cbe930 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63752024-12-21T07:52:28.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34cf552c-d94b-4ce4-8fb4-11ca93cbe930 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63762024-12-21T07:52:29.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 253b9572-9595-4647-9332-695bc8da937f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63772024-12-21T07:52:29.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 253b9572-9595-4647-9332-695bc8da937f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63782024-12-21T07:52:29.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 253b9572-9595-4647-9332-695bc8da937f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63792024-12-21T07:52:30.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c4ec1f66-b366-4cc0-99e5-46ac34ad3634 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63802024-12-21T07:52:30.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c4ec1f66-b366-4cc0-99e5-46ac34ad3634 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63812024-12-21T07:52:30.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c4ec1f66-b366-4cc0-99e5-46ac34ad3634 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63822024-12-21T07:52:31.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35518c5a-b4b7-4df3-9ca7-5a9ef59f4e22 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63832024-12-21T07:52:31.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35518c5a-b4b7-4df3-9ca7-5a9ef59f4e22 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63842024-12-21T07:52:31.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35518c5a-b4b7-4df3-9ca7-5a9ef59f4e22 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63852024-12-21T07:52:32.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 952d2478-4f9e-4470-a842-3e0146a7a8d4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63862024-12-21T07:52:32.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 952d2478-4f9e-4470-a842-3e0146a7a8d4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63872024-12-21T07:52:32.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 952d2478-4f9e-4470-a842-3e0146a7a8d4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63882024-12-21T07:52:33.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 201f638f-661b-40fd-a384-58dfb9eafa6a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63892024-12-21T07:52:33.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 201f638f-661b-40fd-a384-58dfb9eafa6a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63902024-12-21T07:52:33.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 201f638f-661b-40fd-a384-58dfb9eafa6a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
63912024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
63922024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63932024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
63942024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63952024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63962024-12-21T07:52:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63972024-12-21T07:52:33.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63982024-12-21T07:52:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63992024-12-21T07:52:33.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64002024-12-21T07:52:33.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.845606ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64012024-12-21T07:52:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64022024-12-21T07:52:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64032024-12-21T07:52:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64042024-12-21T07:52:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64052024-12-21T07:52:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64062024-12-21T07:52:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64072024-12-21T07:52:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
64082024-12-21T07:52:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64092024-12-21T07:52:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64102024-12-21T07:52:33.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
64112024-12-21T07:52:33.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.509395ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
64122024-12-21T07:52:34.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cc074e94-09cc-4644-8ab8-adc189d45ea3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64132024-12-21T07:52:34.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cc074e94-09cc-4644-8ab8-adc189d45ea3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64142024-12-21T07:52:34.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cc074e94-09cc-4644-8ab8-adc189d45ea3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64152024-12-21T07:52:35.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f864cf2-1a99-4225-a936-7eaf34ed3bb8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64162024-12-21T07:52:35.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f864cf2-1a99-4225-a936-7eaf34ed3bb8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64172024-12-21T07:52:35.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f864cf2-1a99-4225-a936-7eaf34ed3bb8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64182024-12-21T07:52:35.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 3c6bb980-d8ee-40cd-ade9-67caacb482bd response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
64192024-12-21T07:52:36.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b8f05513-349a-4373-bf75-6dbad1273f48 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64202024-12-21T07:52:36.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b8f05513-349a-4373-bf75-6dbad1273f48 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64212024-12-21T07:52:36.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b8f05513-349a-4373-bf75-6dbad1273f48 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64222024-12-21T07:52:37.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbd81a7d-9452-4538-a2ad-71f4825391bf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64232024-12-21T07:52:37.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbd81a7d-9452-4538-a2ad-71f4825391bf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64242024-12-21T07:52:37.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbd81a7d-9452-4538-a2ad-71f4825391bf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64252024-12-21T07:52:38.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34f88a74-d324-4de4-a3d0-42f14508a09e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64262024-12-21T07:52:38.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34f88a74-d324-4de4-a3d0-42f14508a09e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64272024-12-21T07:52:38.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 34f88a74-d324-4de4-a3d0-42f14508a09e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64282024-12-21T07:52:39.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5bf6af7c-10ef-4163-a46a-00915d3795c6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64292024-12-21T07:52:39.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5bf6af7c-10ef-4163-a46a-00915d3795c6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64302024-12-21T07:52:39.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5bf6af7c-10ef-4163-a46a-00915d3795c6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64312024-12-21T07:52:40.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a85d2d7f-5a61-49f1-9ca8-30eefd2623b6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64322024-12-21T07:52:40.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a85d2d7f-5a61-49f1-9ca8-30eefd2623b6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64332024-12-21T07:52:40.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a85d2d7f-5a61-49f1-9ca8-30eefd2623b6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64342024-12-21T07:52:41.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a49ae81-d1ce-4169-8bfc-a6ddaf570f3a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64352024-12-21T07:52:41.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a49ae81-d1ce-4169-8bfc-a6ddaf570f3a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64362024-12-21T07:52:41.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a49ae81-d1ce-4169-8bfc-a6ddaf570f3a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64372024-12-21T07:52:42.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b28bb373-88fc-4253-a647-fb2f0c6fdce2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64382024-12-21T07:52:42.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b28bb373-88fc-4253-a647-fb2f0c6fdce2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64392024-12-21T07:52:42.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b28bb373-88fc-4253-a647-fb2f0c6fdce2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64402024-12-21T07:52:43.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d15b3eb-999e-443e-86cc-f8b42647c63c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64412024-12-21T07:52:43.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d15b3eb-999e-443e-86cc-f8b42647c63c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64422024-12-21T07:52:43.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d15b3eb-999e-443e-86cc-f8b42647c63c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64432024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
64442024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64452024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
64462024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64472024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64482024-12-21T07:52:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64492024-12-21T07:52:43.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64502024-12-21T07:52:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64512024-12-21T07:52:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64522024-12-21T07:52:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64532024-12-21T07:52:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64542024-12-21T07:52:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64552024-12-21T07:52:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64562024-12-21T07:52:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
64572024-12-21T07:52:43.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64582024-12-21T07:52:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64592024-12-21T07:52:43.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
64602024-12-21T07:52:43.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.823103ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
64612024-12-21T07:52:43.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64622024-12-21T07:52:43.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64632024-12-21T07:52:43.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.007582ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64642024-12-21T07:52:44.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d93822e4-2c1a-4a4b-80b3-805399525ad2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64652024-12-21T07:52:44.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d93822e4-2c1a-4a4b-80b3-805399525ad2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64662024-12-21T07:52:44.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d93822e4-2c1a-4a4b-80b3-805399525ad2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64672024-12-21T07:52:45.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bfa7a73-bcc7-4a98-b5ae-f283b3a141ae roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64682024-12-21T07:52:45.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bfa7a73-bcc7-4a98-b5ae-f283b3a141ae resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64692024-12-21T07:52:45.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1bfa7a73-bcc7-4a98-b5ae-f283b3a141ae response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64702024-12-21T07:52:45.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = e5d7c33b-2c29-4992-85b9-3f9579cdeca0 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
64712024-12-21T07:52:46.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3902be5e-d619-4bf0-b1b8-7d2562dee728 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64722024-12-21T07:52:46.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3902be5e-d619-4bf0-b1b8-7d2562dee728 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64732024-12-21T07:52:46.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3902be5e-d619-4bf0-b1b8-7d2562dee728 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64742024-12-21T07:52:47.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2ef6ec2-1651-414f-b03c-aaaf9b4fff48 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64752024-12-21T07:52:47.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2ef6ec2-1651-414f-b03c-aaaf9b4fff48 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64762024-12-21T07:52:47.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2ef6ec2-1651-414f-b03c-aaaf9b4fff48 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64772024-12-21T07:52:48.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7771ca4-774d-4333-8ce3-4c7e3ab10165 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64782024-12-21T07:52:48.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7771ca4-774d-4333-8ce3-4c7e3ab10165 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64792024-12-21T07:52:48.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7771ca4-774d-4333-8ce3-4c7e3ab10165 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64802024-12-21T07:52:49.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3c6595-fe2b-4556-83e1-7d3dfed84ef3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64812024-12-21T07:52:49.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3c6595-fe2b-4556-83e1-7d3dfed84ef3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64822024-12-21T07:52:49.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed3c6595-fe2b-4556-83e1-7d3dfed84ef3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64832024-12-21T07:52:50.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20892763-d2a3-4538-9a1b-dc6aab949152 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64842024-12-21T07:52:50.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20892763-d2a3-4538-9a1b-dc6aab949152 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64852024-12-21T07:52:50.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20892763-d2a3-4538-9a1b-dc6aab949152 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64862024-12-21T07:52:51.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 79bb9c04-61af-4cdd-99c4-cc958cbe723b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64872024-12-21T07:52:51.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 79bb9c04-61af-4cdd-99c4-cc958cbe723b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64882024-12-21T07:52:51.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 79bb9c04-61af-4cdd-99c4-cc958cbe723b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64892024-12-21T07:52:52.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1c91a34-d5cf-404b-b847-5a9e8aa21579 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64902024-12-21T07:52:52.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1c91a34-d5cf-404b-b847-5a9e8aa21579 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64912024-12-21T07:52:52.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1c91a34-d5cf-404b-b847-5a9e8aa21579 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
64922024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
64932024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64942024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
64952024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64962024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
64972024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
64982024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64992024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
65002024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65012024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65022024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65032024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
65042024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
65052024-12-21T07:52:53.580ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65062024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65072024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65082024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
65092024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
65102024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
65112024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65122024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65132024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
65142024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65152024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
65162024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
65172024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65182024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65192024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
65202024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65212024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
65222024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65232024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
65242024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65252024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
65262024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65272024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65282024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65292024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65302024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65312024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65322024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65332024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65342024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65352024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65362024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65372024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65382024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65392024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65402024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65412024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65422024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65432024-12-21T07:52:53.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f70112a0-0738-4247-ba7d-76a84403b519 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
65442024-12-21T07:52:53.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f70112a0-0738-4247-ba7d-76a84403b519 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
65452024-12-21T07:52:53.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-12-21T07:52:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.611462ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65472024-12-21T07:52:53.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65482024-12-21T07:52:53.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.553528ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
65492024-12-21T07:52:53.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65502024-12-21T07:52:53.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65512024-12-21T07:52:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65522024-12-21T07:52:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65532024-12-21T07:52:53.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65542024-12-21T07:52:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65552024-12-21T07:52:53.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 541178236 } })
65562024-12-21T07:52:53.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65572024-12-21T07:52:53.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65582024-12-21T07:52:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65592024-12-21T07:52:53.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65602024-12-21T07:52:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65612024-12-21T07:52:53.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65622024-12-21T07:52:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65632024-12-21T07:52:53.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65642024-12-21T07:52:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65652024-12-21T07:52:53.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 558800548 } })
65662024-12-21T07:52:53.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65672024-12-21T07:52:53.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f70112a0-0738-4247-ba7d-76a84403b519 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
65682024-12-21T07:52:53.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-12-21T07:52:53.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702024-12-21T07:52:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65712024-12-21T07:52:53.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65722024-12-21T07:52:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65732024-12-21T07:52:53.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65742024-12-21T07:52:53.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65752024-12-21T07:52:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65762024-12-21T07:52:53.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65772024-12-21T07:52:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65782024-12-21T07:52:53.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65792024-12-21T07:52:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65802024-12-21T07:52:53.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65812024-12-21T07:52:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65822024-12-21T07:52:53.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65832024-12-21T07:52:53.655ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65842024-12-21T07:52:53.655ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65852024-12-21T07:52:53.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65862024-12-21T07:52:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65872024-12-21T07:52:53.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65882024-12-21T07:52:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65892024-12-21T07:52:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65902024-12-21T07:52:53.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65912024-12-21T07:52:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65922024-12-21T07:52:53.659ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65932024-12-21T07:52:53.659ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65942024-12-21T07:52:53.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65952024-12-21T07:52:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65962024-12-21T07:52:53.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65972024-12-21T07:52:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65982024-12-21T07:52:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65992024-12-21T07:52:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.883928ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
66002024-12-21T07:52:53.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66012024-12-21T07:52:53.662ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 612355406 } })
66022024-12-21T07:52:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66032024-12-21T07:52:53.662ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
66042024-12-21T07:52:53.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66052024-12-21T07:52:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66062024-12-21T07:52:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
66072024-12-21T07:52:53.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66082024-12-21T07:52:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66092024-12-21T07:52:53.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66102024-12-21T07:52:53.671ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66112024-12-21T07:52:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.487232ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66122024-12-21T07:52:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.748926ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66132024-12-21T07:52:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66142024-12-21T07:52:53.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66152024-12-21T07:52:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66162024-12-21T07:52:53.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66172024-12-21T07:52:53.672ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66182024-12-21T07:52:53.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ae14c6-c72c-4b5a-8033-5cae398fff2c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66192024-12-21T07:52:53.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66202024-12-21T07:52:53.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66212024-12-21T07:52:53.680ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.097677ms iteration = 14 status = {"physical_disks_added":0}
66222024-12-21T07:52:53.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
66232024-12-21T07:52:53.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.301873ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
66242024-12-21T07:52:53.690ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66252024-12-21T07:52:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66262024-12-21T07:52:53.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66272024-12-21T07:52:53.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66282024-12-21T07:52:53.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66292024-12-21T07:52:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66302024-12-21T07:52:53.699ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66312024-12-21T07:52:53.699ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66322024-12-21T07:52:53.699ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9457e5cb-9e04-492c-be8a-a11df6a708bb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66332024-12-21T07:52:53.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66342024-12-21T07:52:53.701ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66352024-12-21T07:52:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.852244ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66362024-12-21T07:52:53.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.255432ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66372024-12-21T07:52:53.707ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66382024-12-21T07:52:53.707ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66392024-12-21T07:52:53.707ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.54587ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66402024-12-21T07:52:53.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66412024-12-21T07:52:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66422024-12-21T07:52:53.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.310098ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66432024-12-21T07:52:53.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66442024-12-21T07:52:53.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
66452024-12-21T07:52:53.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66462024-12-21T07:52:53.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66472024-12-21T07:52:53.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66482024-12-21T07:52:53.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66492024-12-21T07:52:53.791ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
66502024-12-21T07:52:53.791ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66512024-12-21T07:52:53.791ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0a31a6a-f9aa-49e7-a674-199bca3dcda5", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66522024-12-21T07:52:53.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66532024-12-21T07:52:53.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
66542024-12-21T07:52:53.839ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66552024-12-21T07:52:53.839ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66562024-12-21T07:52:53.839ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10fb1faf-f1b7-473a-8159-da9e1cf3b36e", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66572024-12-21T07:52:53.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66582024-12-21T07:52:53.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66592024-12-21T07:52:53.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66602024-12-21T07:52:53.841ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 260.958376ms iteration = 12 status = 0
66612024-12-21T07:52:53.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66622024-12-21T07:52:53.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66632024-12-21T07:52:53.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66642024-12-21T07:52:53.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66652024-12-21T07:52:53.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66662024-12-21T07:52:53.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66672024-12-21T07:52:53.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66682024-12-21T07:52:53.864ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66692024-12-21T07:52:53.864ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "060199a8-4d68-467c-a8c8-796dc7b87b23", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66702024-12-21T07:52:53.865ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66712024-12-21T07:52:53.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66722024-12-21T07:52:53.868ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.728415ms iteration = 12 status = null
66732024-12-21T07:52:53.883ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66742024-12-21T07:52:53.883ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66752024-12-21T07:52:53.888ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.147135ms iteration = 12 status = {}
66762024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0e37bdcf-e6ce-44fe-b48b-7b442d057099", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66772024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66782024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66792024-12-21T07:52:53.973ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66802024-12-21T07:52:53.975ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e70768-61aa-447e-b36b-88f0e1124498", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66812024-12-21T07:52:53.975ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66822024-12-21T07:52:53.975ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66832024-12-21T07:52:53.975ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66842024-12-21T07:52:53.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66852024-12-21T07:52:53.975ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 395.298259ms iteration = 12 status = {}
66862024-12-21T07:52:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66872024-12-21T07:52:53.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66882024-12-21T07:52:53.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66892024-12-21T07:52:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66902024-12-21T07:52:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66912024-12-21T07:52:53.981ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
66922024-12-21T07:52:53.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66932024-12-21T07:52:53.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66942024-12-21T07:52:53.982ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66952024-12-21T07:52:53.982ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66962024-12-21T07:52:53.983ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42c50d8c-04e5-4f35-9668-b62db780059a", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
66972024-12-21T07:52:53.985ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 404.217362ms iteration = 12 status = {}
66982024-12-21T07:52:53.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66992024-12-21T07:52:53.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25074ab0-ded4-480e-89f8-c3854c41fa1d", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
67002024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67012024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
67022024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67032024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67042024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67052024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67062024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67072024-12-21T07:52:53.991ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67082024-12-21T07:52:53.992ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67092024-12-21T07:52:53.992ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67102024-12-21T07:52:53.992ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
67112024-12-21T07:52:53.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67122024-12-21T07:52:53.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67132024-12-21T07:52:53.994ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67142024-12-21T07:52:53.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e59da4ec-c1d7-4194-b06c-30490727ea27", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
67152024-12-21T07:52:53.994ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67162024-12-21T07:52:53.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d62a78e1-d372-4727-8549-93201b4d7eae", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
67172024-12-21T07:52:53.994ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
67182024-12-21T07:52:53.994ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67192024-12-21T07:52:54.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "98d961ca-64d5-402c-866f-e55d6249d5fe", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
67202024-12-21T07:52:54.154ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
67212024-12-21T07:52:54.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67222024-12-21T07:52:54.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c887af7-0995-4d16-97ed-5dbf01f46db7", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
67232024-12-21T07:52:54.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67242024-12-21T07:52:54.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67252024-12-21T07:52:54.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67262024-12-21T07:52:54.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67272024-12-21T07:52:54.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67282024-12-21T07:52:54.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67292024-12-21T07:52:54.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67302024-12-21T07:52:54.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67312024-12-21T07:52:54.170ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 589.737935ms iteration = 12 status = {}
67322024-12-21T07:52:54.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c853b2-4b13-4bd8-8bbd-e20f555f687c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67332024-12-21T07:52:54.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c853b2-4b13-4bd8-8bbd-e20f555f687c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67342024-12-21T07:52:54.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c853b2-4b13-4bd8-8bbd-e20f555f687c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67352024-12-21T07:52:55.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e95bc683-8018-4a16-a43f-8c8322bc2749 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67362024-12-21T07:52:55.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e95bc683-8018-4a16-a43f-8c8322bc2749 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67372024-12-21T07:52:55.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e95bc683-8018-4a16-a43f-8c8322bc2749 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67382024-12-21T07:52:55.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 043b579a-8c23-4245-90e4-d931ae61d41c response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
67392024-12-21T07:52:56.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f921f66-285f-4474-89e8-17d830868eb5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67402024-12-21T07:52:56.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f921f66-285f-4474-89e8-17d830868eb5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67412024-12-21T07:52:56.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6f921f66-285f-4474-89e8-17d830868eb5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67422024-12-21T07:52:57.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46e5054b-79ad-4d69-a530-a544f54eb45f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67432024-12-21T07:52:57.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46e5054b-79ad-4d69-a530-a544f54eb45f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67442024-12-21T07:52:57.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46e5054b-79ad-4d69-a530-a544f54eb45f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67452024-12-21T07:52:58.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = aa26759c-4cfc-4ae4-b1b6-c1239157ad4e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67462024-12-21T07:52:58.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = aa26759c-4cfc-4ae4-b1b6-c1239157ad4e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67472024-12-21T07:52:58.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = aa26759c-4cfc-4ae4-b1b6-c1239157ad4e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67482024-12-21T07:52:59.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7a3e428-462a-4613-b8be-c8f69ecdeed6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67492024-12-21T07:52:59.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7a3e428-462a-4613-b8be-c8f69ecdeed6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67502024-12-21T07:52:59.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7a3e428-462a-4613-b8be-c8f69ecdeed6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67512024-12-21T07:53:00.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a6e893b1-979a-41e2-88e0-404e930257af roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67522024-12-21T07:53:00.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a6e893b1-979a-41e2-88e0-404e930257af resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67532024-12-21T07:53:00.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a6e893b1-979a-41e2-88e0-404e930257af response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67542024-12-21T07:53:01.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b608253-3d87-4c9d-8340-27f86671b91e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67552024-12-21T07:53:01.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b608253-3d87-4c9d-8340-27f86671b91e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67562024-12-21T07:53:01.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4b608253-3d87-4c9d-8340-27f86671b91e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67572024-12-21T07:53:02.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac47eb9-104d-4a14-a9c7-5bd3e6a8cca7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67582024-12-21T07:53:02.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac47eb9-104d-4a14-a9c7-5bd3e6a8cca7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67592024-12-21T07:53:02.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eac47eb9-104d-4a14-a9c7-5bd3e6a8cca7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67602024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
67612024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67622024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
67632024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67642024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67652024-12-21T07:53:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67662024-12-21T07:53:03.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67672024-12-21T07:53:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67682024-12-21T07:53:03.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67692024-12-21T07:53:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67702024-12-21T07:53:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67712024-12-21T07:53:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67722024-12-21T07:53:03.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67732024-12-21T07:53:03.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
67742024-12-21T07:53:03.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67752024-12-21T07:53:03.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67762024-12-21T07:53:03.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
67772024-12-21T07:53:03.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.493873ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
67782024-12-21T07:53:03.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67792024-12-21T07:53:03.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67802024-12-21T07:53:03.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.031718ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67812024-12-21T07:53:03.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e57d589-2e62-44ec-9fdd-59158b10d21f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67822024-12-21T07:53:03.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e57d589-2e62-44ec-9fdd-59158b10d21f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67832024-12-21T07:53:03.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e57d589-2e62-44ec-9fdd-59158b10d21f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67842024-12-21T07:53:04.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be94063a-d5b4-4f5f-a45b-0da511e0836e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67852024-12-21T07:53:04.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be94063a-d5b4-4f5f-a45b-0da511e0836e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67862024-12-21T07:53:04.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be94063a-d5b4-4f5f-a45b-0da511e0836e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67872024-12-21T07:53:05.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d02b5be-c197-47b4-92af-564565beff16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67882024-12-21T07:53:05.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d02b5be-c197-47b4-92af-564565beff16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67892024-12-21T07:53:05.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d02b5be-c197-47b4-92af-564565beff16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67902024-12-21T07:53:05.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = d5cdffdb-edae-4df3-a9e4-7666128dcc75 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
67912024-12-21T07:53:06.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f72b2695-82ed-4ffd-adff-e3b715a9e3c7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67922024-12-21T07:53:06.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f72b2695-82ed-4ffd-adff-e3b715a9e3c7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67932024-12-21T07:53:06.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f72b2695-82ed-4ffd-adff-e3b715a9e3c7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67942024-12-21T07:53:07.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b19c2568-34c9-44ba-a8f6-2cb6ce107c70 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67952024-12-21T07:53:07.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b19c2568-34c9-44ba-a8f6-2cb6ce107c70 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67962024-12-21T07:53:07.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b19c2568-34c9-44ba-a8f6-2cb6ce107c70 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67972024-12-21T07:53:08.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bd3bd5f-183f-4aeb-b359-52fc4aed26c9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67982024-12-21T07:53:08.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bd3bd5f-183f-4aeb-b359-52fc4aed26c9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
67992024-12-21T07:53:08.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3bd3bd5f-183f-4aeb-b359-52fc4aed26c9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68002024-12-21T07:53:09.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4974765d-c356-46c1-9254-ed881e9d676d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68012024-12-21T07:53:09.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4974765d-c356-46c1-9254-ed881e9d676d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68022024-12-21T07:53:09.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4974765d-c356-46c1-9254-ed881e9d676d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68032024-12-21T07:53:10.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e1363a11-41b1-45dc-9bed-66f350992d93 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68042024-12-21T07:53:10.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e1363a11-41b1-45dc-9bed-66f350992d93 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68052024-12-21T07:53:10.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e1363a11-41b1-45dc-9bed-66f350992d93 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68062024-12-21T07:53:12.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 421365fa-883d-4061-8242-4c690199e9f3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68072024-12-21T07:53:12.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 421365fa-883d-4061-8242-4c690199e9f3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68082024-12-21T07:53:12.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 421365fa-883d-4061-8242-4c690199e9f3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68092024-12-21T07:53:13.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c8dfd63-1177-42bc-b530-abeb6248342e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68102024-12-21T07:53:13.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c8dfd63-1177-42bc-b530-abeb6248342e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68112024-12-21T07:53:13.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c8dfd63-1177-42bc-b530-abeb6248342e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68122024-12-21T07:53:13.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
68132024-12-21T07:53:13.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68142024-12-21T07:53:13.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
68152024-12-21T07:53:13.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68162024-12-21T07:53:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68172024-12-21T07:53:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68182024-12-21T07:53:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68192024-12-21T07:53:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68202024-12-21T07:53:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68212024-12-21T07:53:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68222024-12-21T07:53:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68232024-12-21T07:53:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68242024-12-21T07:53:13.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68252024-12-21T07:53:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68262024-12-21T07:53:13.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68272024-12-21T07:53:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
68282024-12-21T07:53:13.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68292024-12-21T07:53:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68302024-12-21T07:53:13.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
68312024-12-21T07:53:13.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.696081ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
68322024-12-21T07:53:13.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.096842ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68332024-12-21T07:53:14.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8b7d0e77-0898-459a-a0a7-f5f27c318938 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68342024-12-21T07:53:14.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8b7d0e77-0898-459a-a0a7-f5f27c318938 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68352024-12-21T07:53:14.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8b7d0e77-0898-459a-a0a7-f5f27c318938 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68362024-12-21T07:53:15.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af274ba4-9daa-4eda-bf86-ed721b87968e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68372024-12-21T07:53:15.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af274ba4-9daa-4eda-bf86-ed721b87968e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68382024-12-21T07:53:15.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af274ba4-9daa-4eda-bf86-ed721b87968e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68392024-12-21T07:53:15.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 853 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = e04a82fd-153e-4612-9809-d451e7709df1 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
68402024-12-21T07:53:16.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644a2a1c-aad8-45b8-a58b-bb8d11fb0f41 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68412024-12-21T07:53:16.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644a2a1c-aad8-45b8-a58b-bb8d11fb0f41 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68422024-12-21T07:53:16.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 644a2a1c-aad8-45b8-a58b-bb8d11fb0f41 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68432024-12-21T07:53:17.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39663ab2-46e6-49dd-a7a0-23d589665d4b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68442024-12-21T07:53:17.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39663ab2-46e6-49dd-a7a0-23d589665d4b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68452024-12-21T07:53:17.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39663ab2-46e6-49dd-a7a0-23d589665d4b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68462024-12-21T07:53:18.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 32869d7d-a36b-4fdb-83c3-6eac17b77774 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68472024-12-21T07:53:18.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 32869d7d-a36b-4fdb-83c3-6eac17b77774 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68482024-12-21T07:53:18.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 32869d7d-a36b-4fdb-83c3-6eac17b77774 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68492024-12-21T07:53:19.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef1b0a5a-e921-40df-bd6d-caa7942ab833 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68502024-12-21T07:53:19.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef1b0a5a-e921-40df-bd6d-caa7942ab833 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68512024-12-21T07:53:19.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef1b0a5a-e921-40df-bd6d-caa7942ab833 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68522024-12-21T07:53:20.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbe66ab3-0401-48f2-8b5d-12ae33831688 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68532024-12-21T07:53:20.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbe66ab3-0401-48f2-8b5d-12ae33831688 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68542024-12-21T07:53:20.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbe66ab3-0401-48f2-8b5d-12ae33831688 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68552024-12-21T07:53:21.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 119980e4-98e5-4837-9b26-7bf21aa227be roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68562024-12-21T07:53:21.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 119980e4-98e5-4837-9b26-7bf21aa227be resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68572024-12-21T07:53:21.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 119980e4-98e5-4837-9b26-7bf21aa227be response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68582024-12-21T07:53:22.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 74a0d067-b4a4-42a7-bd76-ae6cf8146bc8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68592024-12-21T07:53:22.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 74a0d067-b4a4-42a7-bd76-ae6cf8146bc8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68602024-12-21T07:53:22.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 74a0d067-b4a4-42a7-bd76-ae6cf8146bc8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68612024-12-21T07:53:23.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30212914-c566-4f2e-bc2a-2dcbfee7be4f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68622024-12-21T07:53:23.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30212914-c566-4f2e-bc2a-2dcbfee7be4f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68632024-12-21T07:53:23.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30212914-c566-4f2e-bc2a-2dcbfee7be4f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
68642024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
68652024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
68662024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68672024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68682024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
68692024-12-21T07:53:23.580ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68702024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
68712024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68722024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68732024-12-21T07:53:23.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
68742024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
68752024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68762024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
68772024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68782024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68792024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68802024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
68812024-12-21T07:53:23.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
68822024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
68832024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
68842024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.18\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
68852024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
68862024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68872024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
68882024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68892024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68902024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
68912024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68922024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
68932024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68942024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
68952024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68962024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68972024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
68982024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68992024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
69002024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69012024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
69022024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69032024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
69042024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69052024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69062024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
69072024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69082024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69092024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
69102024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
69112024-12-21T07:53:23.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:43:23.581241670 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69122024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69132024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69142024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
69152024-12-21T07:53:23.581ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69162024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69172024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
69182024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69192024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
69202024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
69212024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69222024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
69232024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69242024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69252024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
69262024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69272024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
69282024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69292024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69302024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69312024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69322024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69332024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69342024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69352024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69362024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69372024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69382024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69392024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69402024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69412024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69422024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69432024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69442024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69452024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69462024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69472024-12-21T07:53:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69482024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69492024-12-21T07:53:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 531711283 } })
69502024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69512024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69522024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69532024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69542024-12-21T07:53:23.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 531774474 } })
69552024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69562024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69572024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69582024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69592024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69602024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
69612024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.676079ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
69622024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69632024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69642024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
69652024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.603908ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
69662024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69672024-12-21T07:53:23.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69682024-12-21T07:53:23.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69692024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69702024-12-21T07:53:23.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 536768660 } })
69712024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69722024-12-21T07:53:23.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69732024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.691025ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69742024-12-21T07:53:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69752024-12-21T07:53:23.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69762024-12-21T07:53:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69772024-12-21T07:53:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69782024-12-21T07:53:23.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69792024-12-21T07:53:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69802024-12-21T07:53:23.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812024-12-21T07:53:23.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69822024-12-21T07:53:23.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 546672060 } })
69832024-12-21T07:53:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69842024-12-21T07:53:23.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69852024-12-21T07:53:23.598ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:43:23.581241670 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69862024-12-21T07:53:23.598ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.140664ms iteration = 7 status = {"expiration":"2024-12-21T07:43:23.581241670Z","pruned":[]}
69872024-12-21T07:53:23.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69882024-12-21T07:53:23.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69892024-12-21T07:53:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69902024-12-21T07:53:23.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69912024-12-21T07:53:23.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922024-12-21T07:53:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69932024-12-21T07:53:23.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69942024-12-21T07:53:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69952024-12-21T07:53:23.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69962024-12-21T07:53:23.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69972024-12-21T07:53:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69982024-12-21T07:53:23.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69992024-12-21T07:53:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70002024-12-21T07:53:23.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70012024-12-21T07:53:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70022024-12-21T07:53:23.634ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 53.166862ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
70032024-12-21T07:53:23.643ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70042024-12-21T07:53:23.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70052024-12-21T07:53:23.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70062024-12-21T07:53:23.647ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70072024-12-21T07:53:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70082024-12-21T07:53:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70092024-12-21T07:53:23.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70102024-12-21T07:53:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70112024-12-21T07:53:23.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122024-12-21T07:53:23.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70132024-12-21T07:53:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70142024-12-21T07:53:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70152024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
70162024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
70172024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
70182024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70192024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70202024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70212024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70222024-12-21T07:53:23.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 99.727991ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
70232024-12-21T07:53:23.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70242024-12-21T07:53:23.687ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70252024-12-21T07:53:23.687ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70262024-12-21T07:53:23.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70272024-12-21T07:53:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70282024-12-21T07:53:23.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70292024-12-21T07:53:23.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70302024-12-21T07:53:23.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70312024-12-21T07:53:23.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 110.251961ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
70322024-12-21T07:53:23.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70332024-12-21T07:53:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70342024-12-21T07:53:23.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70352024-12-21T07:53:23.699ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70362024-12-21T07:53:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70372024-12-21T07:53:23.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70382024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70392024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70402024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70412024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70422024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70432024-12-21T07:53:23.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442024-12-21T07:53:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70452024-12-21T07:53:23.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70462024-12-21T07:53:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70472024-12-21T07:53:23.707ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70482024-12-21T07:53:23.707ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70492024-12-21T07:53:23.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70502024-12-21T07:53:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70512024-12-21T07:53:23.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522024-12-21T07:53:23.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532024-12-21T07:53:23.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70542024-12-21T07:53:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70552024-12-21T07:53:23.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70562024-12-21T07:53:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70572024-12-21T07:53:23.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70582024-12-21T07:53:23.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70592024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70602024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70612024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70622024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70632024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70642024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70652024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70662024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70672024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70682024-12-21T07:53:23.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70692024-12-21T07:53:23.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70702024-12-21T07:53:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70712024-12-21T07:53:23.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70722024-12-21T07:53:23.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70732024-12-21T07:53:23.722ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70742024-12-21T07:53:23.722ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.609691ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70752024-12-21T07:53:23.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70762024-12-21T07:53:23.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70772024-12-21T07:53:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70782024-12-21T07:53:23.728ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70792024-12-21T07:53:23.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 678082664 } })
70802024-12-21T07:53:23.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
70812024-12-21T07:53:23.729ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "851ae35e-f0d1-4d9b-9fe1-345b62684642", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
70822024-12-21T07:53:23.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70832024-12-21T07:53:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70842024-12-21T07:53:23.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70852024-12-21T07:53:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70862024-12-21T07:53:23.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70872024-12-21T07:53:23.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70882024-12-21T07:53:23.732ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 151.717482ms iteration = 4 status = {"nsuccess":5}
70892024-12-21T07:53:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
70902024-12-21T07:53:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70912024-12-21T07:53:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70922024-12-21T07:53:23.739ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70932024-12-21T07:53:23.739ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70942024-12-21T07:53:23.739ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70952024-12-21T07:53:23.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70962024-12-21T07:53:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70972024-12-21T07:53:23.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982024-12-21T07:53:23.743ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70992024-12-21T07:53:23.743ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71002024-12-21T07:53:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 162.294794ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71012024-12-21T07:53:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71022024-12-21T07:53:23.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71032024-12-21T07:53:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71042024-12-21T07:53:23.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71052024-12-21T07:53:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71062024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71072024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
71082024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71092024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71102024-12-21T07:53:23.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112024-12-21T07:53:23.759ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71122024-12-21T07:53:23.759ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71132024-12-21T07:53:23.759ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 178.531162ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71142024-12-21T07:53:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71152024-12-21T07:53:23.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71162024-12-21T07:53:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71172024-12-21T07:53:23.761ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
71182024-12-21T07:53:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.703929ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
71192024-12-21T07:53:23.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71202024-12-21T07:53:23.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71212024-12-21T07:53:23.762ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e762a90c-7f93-49b5-9df8-d69fd7edf982", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
71222024-12-21T07:53:23.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71232024-12-21T07:53:23.763ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
71242024-12-21T07:53:23.763ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71252024-12-21T07:53:23.763ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
71262024-12-21T07:53:23.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 182.607162ms iteration = 7 status = {"generation":2}
71272024-12-21T07:53:23.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71282024-12-21T07:53:23.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71292024-12-21T07:53:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71302024-12-21T07:53:23.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 183.579419ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71312024-12-21T07:53:23.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71322024-12-21T07:53:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71332024-12-21T07:53:23.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71342024-12-21T07:53:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71352024-12-21T07:53:23.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71362024-12-21T07:53:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71372024-12-21T07:53:23.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 196.605742ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71382024-12-21T07:53:23.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71392024-12-21T07:53:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71402024-12-21T07:53:23.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412024-12-21T07:53:23.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
71422024-12-21T07:53:23.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71432024-12-21T07:53:23.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71442024-12-21T07:53:23.791ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 210.367788ms iteration = 13 status = 0
71452024-12-21T07:53:23.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71462024-12-21T07:53:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71472024-12-21T07:53:23.792ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71482024-12-21T07:53:23.792ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71492024-12-21T07:53:23.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 211.050349ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71502024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71512024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71522024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71532024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71542024-12-21T07:53:23.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 213.860118ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71552024-12-21T07:53:23.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71562024-12-21T07:53:23.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71572024-12-21T07:53:23.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71582024-12-21T07:53:23.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 235.847805ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71592024-12-21T07:53:23.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602024-12-21T07:53:23.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612024-12-21T07:53:23.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71622024-12-21T07:53:23.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71632024-12-21T07:53:23.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71642024-12-21T07:53:23.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71652024-12-21T07:53:23.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71662024-12-21T07:53:23.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71672024-12-21T07:53:23.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71682024-12-21T07:53:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 325.418012ms iteration = 15 status = {"physical_disks_added":0}
71692024-12-21T07:53:23.912ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71702024-12-21T07:53:23.912ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 331.552617ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71712024-12-21T07:53:23.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
71722024-12-21T07:53:23.912ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71732024-12-21T07:53:23.913ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3667d95-1c66-4ffe-80bb-09ec83d30de6", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
71742024-12-21T07:53:23.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71752024-12-21T07:53:23.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
71762024-12-21T07:53:23.918ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71772024-12-21T07:53:23.918ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "693778ee-0274-46fb-bf73-59f71b9674ef", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
71782024-12-21T07:53:23.920ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71792024-12-21T07:53:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71802024-12-21T07:53:23.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71812024-12-21T07:53:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71822024-12-21T07:53:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 355.751602ms iteration = 13 status = {}
71832024-12-21T07:53:23.996ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71842024-12-21T07:53:23.996ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71852024-12-21T07:53:23.996ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0138961-f890-4c8e-8c3f-d30e07dc7614", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
71862024-12-21T07:53:23.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71872024-12-21T07:53:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71882024-12-21T07:53:23.998ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.564232ms iteration = 13 status = null
71892024-12-21T07:53:23.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71902024-12-21T07:53:23.999ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71912024-12-21T07:53:23.999ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71922024-12-21T07:53:23.999ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
71932024-12-21T07:53:23.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 417.910118ms iteration = 7 status = {"generation":1}
71942024-12-21T07:53:24.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71952024-12-21T07:53:24.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71962024-12-21T07:53:24.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71972024-12-21T07:53:24.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71982024-12-21T07:53:24.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71992024-12-21T07:53:24.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72002024-12-21T07:53:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012024-12-21T07:53:24.036ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
72022024-12-21T07:53:24.036ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 455.411871ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72032024-12-21T07:53:24.055ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72042024-12-21T07:53:24.055ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72052024-12-21T07:53:24.055ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "507d8823-12b3-49c2-a3ad-a805658faa71", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
72062024-12-21T07:53:24.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72072024-12-21T07:53:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72082024-12-21T07:53:24.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72092024-12-21T07:53:24.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72102024-12-21T07:53:24.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72112024-12-21T07:53:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72122024-12-21T07:53:24.064ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72132024-12-21T07:53:24.064ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72142024-12-21T07:53:24.064ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "591da44a-09f1-4660-817c-ff8522bfadcf", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
72152024-12-21T07:53:24.064ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72162024-12-21T07:53:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.347725ms iteration = 13 status = {}
72172024-12-21T07:53:24.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72182024-12-21T07:53:24.128ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b26a1051-e924-4b62-b6a2-dde053944b76", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72192024-12-21T07:53:24.128ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72202024-12-21T07:53:24.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "09f6c498-e334-4541-bd8d-e347606d4394", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72212024-12-21T07:53:24.130ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72222024-12-21T07:53:24.132ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72232024-12-21T07:53:24.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 551.439049ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72242024-12-21T07:53:24.163ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72252024-12-21T07:53:24.164ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d1340b3-f131-4d39-8f13-c8475bf28d64", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
72262024-12-21T07:53:24.164ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72272024-12-21T07:53:24.164ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72282024-12-21T07:53:24.164ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72292024-12-21T07:53:24.166ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 585.279589ms iteration = 13 status = {}
72302024-12-21T07:53:24.172ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72312024-12-21T07:53:24.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "142453cf-cb6b-46c7-b2d0-a016c41e2a66", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72322024-12-21T07:53:24.172ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72332024-12-21T07:53:24.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "871eb27b-0cd2-4b68-9f73-79611e198727", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72342024-12-21T07:53:24.174ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72352024-12-21T07:53:24.176ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6a630ef3-24b0-4206-804c-3a06c6e05b5d", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72362024-12-21T07:53:24.176ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72372024-12-21T07:53:24.177ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72382024-12-21T07:53:24.177ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
72392024-12-21T07:53:24.178ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72402024-12-21T07:53:24.178ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 597.04673ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72412024-12-21T07:53:24.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72422024-12-21T07:53:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72432024-12-21T07:53:24.190ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
72442024-12-21T07:53:24.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72452024-12-21T07:53:24.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72462024-12-21T07:53:24.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72472024-12-21T07:53:24.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbc35b85-044b-4de7-bc4b-cf1c6a4e3aea", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
72482024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72492024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
72502024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72512024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72522024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72532024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72542024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72552024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72562024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72572024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72582024-12-21T07:53:24.200ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
72592024-12-21T07:53:24.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72602024-12-21T07:53:24.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72612024-12-21T07:53:24.202ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72622024-12-21T07:53:24.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "96dc0daf-b69b-4f6e-92d6-830d9f1808cf", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
72632024-12-21T07:53:24.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72642024-12-21T07:53:24.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7338d6bb-c5be-4aff-80a1-f271c60aaf2a", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
72652024-12-21T07:53:24.203ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
72662024-12-21T07:53:24.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72672024-12-21T07:53:24.211ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
72682024-12-21T07:53:24.211ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:36241
72692024-12-21T07:53:24.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36241 req_id = 58336b22-ef05-4cd9-867a-42b6c30adc2c roles = RoleSet { roles: {} } uri = /metrics/producers
72702024-12-21T07:53:24.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36241 req_id = 58336b22-ef05-4cd9-867a-42b6c30adc2c resource = Database result = Ok(()) uri = /metrics/producers
72712024-12-21T07:53:24.253ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
72722024-12-21T07:53:24.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42102 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36241 req_id = 58336b22-ef05-4cd9-867a-42b6c30adc2c response_code = 201 uri = /metrics/producers
72732024-12-21T07:53:24.253ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "58336b22-ef05-4cd9-867a-42b6c30adc2c", "content-length": "41", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
72742024-12-21T07:53:24.255ZDEBGnexus (producer-registration-task): registered with nexus successfully
72752024-12-21T07:53:24.255ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72762024-12-21T07:53:24.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1491d3be-b21c-47db-b7c8-a06bdbcbb143 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72772024-12-21T07:53:24.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1491d3be-b21c-47db-b7c8-a06bdbcbb143 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72782024-12-21T07:53:24.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1491d3be-b21c-47db-b7c8-a06bdbcbb143 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72792024-12-21T07:53:24.454ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "37957750-9659-47bc-ae89-b2c55cf6cf15", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
72802024-12-21T07:53:24.454ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
72812024-12-21T07:53:24.454ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72822024-12-21T07:53:24.454ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1214edec-1228-4db1-87aa-5a414b02fb40", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
72832024-12-21T07:53:24.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72842024-12-21T07:53:24.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72852024-12-21T07:53:24.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72862024-12-21T07:53:24.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72872024-12-21T07:53:24.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72882024-12-21T07:53:24.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72892024-12-21T07:53:24.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72902024-12-21T07:53:24.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72912024-12-21T07:53:24.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 888.326846ms iteration = 13 status = {}
72922024-12-21T07:53:25.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a36df7a7-0f3b-4125-ae0c-018b9ec35b03 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72932024-12-21T07:53:25.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a36df7a7-0f3b-4125-ae0c-018b9ec35b03 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72942024-12-21T07:53:25.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a36df7a7-0f3b-4125-ae0c-018b9ec35b03 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72952024-12-21T07:53:25.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 51c89d8e-3dea-49c9-bd03-ead6c869e48b response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
72962024-12-21T07:53:26.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0977246-68c4-4a5f-b928-45e6fcd7f7e0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72972024-12-21T07:53:26.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0977246-68c4-4a5f-b928-45e6fcd7f7e0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72982024-12-21T07:53:26.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0977246-68c4-4a5f-b928-45e6fcd7f7e0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
72992024-12-21T07:53:27.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 521b87ab-98a3-43bd-b0b4-abddcb5bc9df roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73002024-12-21T07:53:27.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 521b87ab-98a3-43bd-b0b4-abddcb5bc9df resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73012024-12-21T07:53:27.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 521b87ab-98a3-43bd-b0b4-abddcb5bc9df response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73022024-12-21T07:53:28.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 040fec2a-86fa-48a7-907e-d21b58f1684a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73032024-12-21T07:53:28.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 040fec2a-86fa-48a7-907e-d21b58f1684a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73042024-12-21T07:53:28.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 040fec2a-86fa-48a7-907e-d21b58f1684a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73052024-12-21T07:53:29.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b0667eac-0479-4f56-a2e2-d7ab0e217384 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73062024-12-21T07:53:29.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b0667eac-0479-4f56-a2e2-d7ab0e217384 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73072024-12-21T07:53:29.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b0667eac-0479-4f56-a2e2-d7ab0e217384 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73082024-12-21T07:53:30.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c19b65aa-cb5f-4646-b7ab-5fde5287becd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73092024-12-21T07:53:30.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c19b65aa-cb5f-4646-b7ab-5fde5287becd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73102024-12-21T07:53:30.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c19b65aa-cb5f-4646-b7ab-5fde5287becd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73112024-12-21T07:53:31.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af05b096-dfd9-4936-9925-3cc7bb15c83d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73122024-12-21T07:53:31.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af05b096-dfd9-4936-9925-3cc7bb15c83d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73132024-12-21T07:53:31.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af05b096-dfd9-4936-9925-3cc7bb15c83d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73142024-12-21T07:53:32.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4bda8c9-4852-413e-a755-27b03e2f6364 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73152024-12-21T07:53:32.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4bda8c9-4852-413e-a755-27b03e2f6364 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73162024-12-21T07:53:32.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b4bda8c9-4852-413e-a755-27b03e2f6364 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73172024-12-21T07:53:33.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 684f09ac-d69c-4e7b-94b1-77c839333d8c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73182024-12-21T07:53:33.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 684f09ac-d69c-4e7b-94b1-77c839333d8c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73192024-12-21T07:53:33.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 684f09ac-d69c-4e7b-94b1-77c839333d8c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73202024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
73212024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
73222024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73232024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73242024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73252024-12-21T07:53:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73262024-12-21T07:53:33.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73272024-12-21T07:53:33.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73282024-12-21T07:53:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73292024-12-21T07:53:33.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.618812ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73302024-12-21T07:53:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73312024-12-21T07:53:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73322024-12-21T07:53:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73332024-12-21T07:53:33.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73342024-12-21T07:53:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73352024-12-21T07:53:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73362024-12-21T07:53:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
73372024-12-21T07:53:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73382024-12-21T07:53:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73392024-12-21T07:53:33.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
73402024-12-21T07:53:33.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.530982ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
73412024-12-21T07:53:34.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce864065-6f26-4a12-8712-832297dcf338 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73422024-12-21T07:53:34.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce864065-6f26-4a12-8712-832297dcf338 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73432024-12-21T07:53:34.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce864065-6f26-4a12-8712-832297dcf338 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73442024-12-21T07:53:35.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cb58301d-c4f0-4a4a-806e-c37fd427a8b7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73452024-12-21T07:53:35.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cb58301d-c4f0-4a4a-806e-c37fd427a8b7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73462024-12-21T07:53:35.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cb58301d-c4f0-4a4a-806e-c37fd427a8b7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73472024-12-21T07:53:35.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 466 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 9b726cb1-3675-4b60-86c6-70a3796eee92 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
73482024-12-21T07:53:36.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1691f7b-e2be-4779-bb82-411cb6461911 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73492024-12-21T07:53:36.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1691f7b-e2be-4779-bb82-411cb6461911 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73502024-12-21T07:53:36.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1691f7b-e2be-4779-bb82-411cb6461911 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73512024-12-21T07:53:37.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72a4b768-a313-4836-8112-b941069dc192 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73522024-12-21T07:53:37.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72a4b768-a313-4836-8112-b941069dc192 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73532024-12-21T07:53:37.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 72a4b768-a313-4836-8112-b941069dc192 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73542024-12-21T07:53:38.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48c1e755-7e39-4504-af4c-d2ab576be289 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73552024-12-21T07:53:38.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48c1e755-7e39-4504-af4c-d2ab576be289 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73562024-12-21T07:53:38.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48c1e755-7e39-4504-af4c-d2ab576be289 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73572024-12-21T07:53:39.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7efb7280-5b9c-4ee2-bb94-09257abb5754 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73582024-12-21T07:53:39.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7efb7280-5b9c-4ee2-bb94-09257abb5754 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73592024-12-21T07:53:39.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7efb7280-5b9c-4ee2-bb94-09257abb5754 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73602024-12-21T07:53:40.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a059b831-09e7-4327-b218-d4e9706d4b0a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73612024-12-21T07:53:40.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a059b831-09e7-4327-b218-d4e9706d4b0a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73622024-12-21T07:53:40.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a059b831-09e7-4327-b218-d4e9706d4b0a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73632024-12-21T07:53:41.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b5c4ab3-1195-460d-8bf0-0c433f5867d1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73642024-12-21T07:53:41.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b5c4ab3-1195-460d-8bf0-0c433f5867d1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73652024-12-21T07:53:41.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b5c4ab3-1195-460d-8bf0-0c433f5867d1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73662024-12-21T07:53:42.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4eb127e-f8a7-4598-b58d-fecea00b5552 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73672024-12-21T07:53:42.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4eb127e-f8a7-4598-b58d-fecea00b5552 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73682024-12-21T07:53:42.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4eb127e-f8a7-4598-b58d-fecea00b5552 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73692024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
73702024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73712024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
73722024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73732024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73742024-12-21T07:53:43.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73752024-12-21T07:53:43.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73762024-12-21T07:53:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73772024-12-21T07:53:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73782024-12-21T07:53:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73792024-12-21T07:53:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73802024-12-21T07:53:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73812024-12-21T07:53:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822024-12-21T07:53:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
73832024-12-21T07:53:43.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73842024-12-21T07:53:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73852024-12-21T07:53:43.603ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
73862024-12-21T07:53:43.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.671589ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
73872024-12-21T07:53:43.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73882024-12-21T07:53:43.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73892024-12-21T07:53:43.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.654513ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73902024-12-21T07:53:43.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93bbc71d-92a4-470b-a2e3-63b1027784ed roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73912024-12-21T07:53:43.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93bbc71d-92a4-470b-a2e3-63b1027784ed resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73922024-12-21T07:53:43.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93bbc71d-92a4-470b-a2e3-63b1027784ed response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73932024-12-21T07:53:44.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad68471-5aee-4181-af87-25593735c369 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73942024-12-21T07:53:44.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad68471-5aee-4181-af87-25593735c369 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73952024-12-21T07:53:44.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad68471-5aee-4181-af87-25593735c369 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73962024-12-21T07:53:45.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0798fbf3-28cf-4761-98b2-cacf12031868 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73972024-12-21T07:53:45.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0798fbf3-28cf-4761-98b2-cacf12031868 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73982024-12-21T07:53:45.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0798fbf3-28cf-4761-98b2-cacf12031868 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
73992024-12-21T07:53:45.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 56523070-7112-4c59-bfb8-f429801b640a response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
74002024-12-21T07:53:46.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c060f933-8921-4e04-ab23-dca62be32f9d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74012024-12-21T07:53:46.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c060f933-8921-4e04-ab23-dca62be32f9d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74022024-12-21T07:53:46.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c060f933-8921-4e04-ab23-dca62be32f9d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74032024-12-21T07:53:47.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ee4ac31b-ec53-4acd-8643-a04f869a9739 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74042024-12-21T07:53:47.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ee4ac31b-ec53-4acd-8643-a04f869a9739 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74052024-12-21T07:53:47.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ee4ac31b-ec53-4acd-8643-a04f869a9739 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74062024-12-21T07:53:48.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ac8c04d-79bb-43a1-88f7-e3ef165c5f51 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74072024-12-21T07:53:48.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ac8c04d-79bb-43a1-88f7-e3ef165c5f51 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74082024-12-21T07:53:48.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1ac8c04d-79bb-43a1-88f7-e3ef165c5f51 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74092024-12-21T07:53:49.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 260e7f05-c7ae-4383-b950-afc96993fb55 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74102024-12-21T07:53:49.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 260e7f05-c7ae-4383-b950-afc96993fb55 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74112024-12-21T07:53:49.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 260e7f05-c7ae-4383-b950-afc96993fb55 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74122024-12-21T07:53:50.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21fa7ffb-6415-4a11-8be7-551b2b5796ba roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74132024-12-21T07:53:50.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21fa7ffb-6415-4a11-8be7-551b2b5796ba resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74142024-12-21T07:53:50.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21fa7ffb-6415-4a11-8be7-551b2b5796ba response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74152024-12-21T07:53:51.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 69d2bd68-ea94-4e17-bdaf-42ac2765897e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74162024-12-21T07:53:51.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 69d2bd68-ea94-4e17-bdaf-42ac2765897e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74172024-12-21T07:53:51.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 69d2bd68-ea94-4e17-bdaf-42ac2765897e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74182024-12-21T07:53:52.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93cf4ed2-c368-4401-999c-07a635fb8674 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74192024-12-21T07:53:52.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93cf4ed2-c368-4401-999c-07a635fb8674 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74202024-12-21T07:53:52.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93cf4ed2-c368-4401-999c-07a635fb8674 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
74212024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
74222024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74232024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
74242024-12-21T07:53:53.581ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74252024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
74262024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74272024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74282024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
74292024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74302024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
74312024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
74322024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74332024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74342024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
74352024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
74362024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74372024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74382024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
74392024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74402024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
74412024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74422024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
74432024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74442024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
74452024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74462024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
74472024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
74482024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74492024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
74502024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74512024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
74522024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
74532024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74542024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74552024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74562024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74572024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74582024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74592024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74602024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74612024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74622024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74642024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74652024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74662024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74672024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74682024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74692024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74702024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74712024-12-21T07:53:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74722024-12-21T07:53:53.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74732024-12-21T07:53:53.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74742024-12-21T07:53:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.860394ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74752024-12-21T07:53:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74762024-12-21T07:53:53.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74772024-12-21T07:53:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74782024-12-21T07:53:53.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 537130456 } })
74792024-12-21T07:53:53.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74802024-12-21T07:53:53.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74812024-12-21T07:53:53.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
74822024-12-21T07:53:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74832024-12-21T07:53:53.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74842024-12-21T07:53:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74852024-12-21T07:53:53.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74862024-12-21T07:53:53.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74872024-12-21T07:53:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74882024-12-21T07:53:53.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74892024-12-21T07:53:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74902024-12-21T07:53:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74912024-12-21T07:53:53.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74922024-12-21T07:53:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74932024-12-21T07:53:53.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74942024-12-21T07:53:53.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.77453ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
74952024-12-21T07:53:53.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74962024-12-21T07:53:53.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74972024-12-21T07:53:53.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74982024-12-21T07:53:53.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74992024-12-21T07:53:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75002024-12-21T07:53:53.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 547371932 } })
75012024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75022024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75032024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75042024-12-21T07:53:53.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75052024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75062024-12-21T07:53:53.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75072024-12-21T07:53:53.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75082024-12-21T07:53:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75092024-12-21T07:53:53.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.273664ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75102024-12-21T07:53:53.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75112024-12-21T07:53:53.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75122024-12-21T07:53:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75132024-12-21T07:53:53.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75142024-12-21T07:53:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75152024-12-21T07:53:53.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 554295881 } })
75162024-12-21T07:53:53.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
75172024-12-21T07:53:53.605ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75182024-12-21T07:53:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.626383ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75192024-12-21T07:53:53.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75202024-12-21T07:53:53.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75212024-12-21T07:53:53.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75222024-12-21T07:53:53.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75232024-12-21T07:53:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75242024-12-21T07:53:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 45.075783ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75252024-12-21T07:53:53.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75262024-12-21T07:53:53.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75272024-12-21T07:53:53.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75282024-12-21T07:53:53.629ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75292024-12-21T07:53:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75302024-12-21T07:53:53.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75312024-12-21T07:53:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75322024-12-21T07:53:53.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75332024-12-21T07:53:53.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75342024-12-21T07:53:53.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75352024-12-21T07:53:53.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75362024-12-21T07:53:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75372024-12-21T07:53:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.141277ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
75382024-12-21T07:53:53.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75392024-12-21T07:53:53.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75402024-12-21T07:53:53.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75412024-12-21T07:53:53.647ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75422024-12-21T07:53:53.647ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75432024-12-21T07:53:53.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75442024-12-21T07:53:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75452024-12-21T07:53:53.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75462024-12-21T07:53:53.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75472024-12-21T07:53:53.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75482024-12-21T07:53:53.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75492024-12-21T07:53:53.660ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75502024-12-21T07:53:53.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75512024-12-21T07:53:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
75522024-12-21T07:53:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75532024-12-21T07:53:53.660ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a3effd9-57d3-44cf-8b9c-e2575a9a2af1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
75542024-12-21T07:53:53.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75552024-12-21T07:53:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75562024-12-21T07:53:53.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75572024-12-21T07:53:53.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75582024-12-21T07:53:53.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75592024-12-21T07:53:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75602024-12-21T07:53:53.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612024-12-21T07:53:53.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75622024-12-21T07:53:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75632024-12-21T07:53:53.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75642024-12-21T07:53:53.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75652024-12-21T07:53:53.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75662024-12-21T07:53:53.671ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
75672024-12-21T07:53:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.662118ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
75682024-12-21T07:53:53.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.508568ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75692024-12-21T07:53:53.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75702024-12-21T07:53:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
75712024-12-21T07:53:53.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75722024-12-21T07:53:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75732024-12-21T07:53:53.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75742024-12-21T07:53:53.699ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75752024-12-21T07:53:53.699ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f84a4e61-cfd1-44f8-9e1b-437685a48a03", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
75762024-12-21T07:53:53.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75772024-12-21T07:53:53.699ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.879171ms iteration = 14 status = 0
75782024-12-21T07:53:53.701ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75792024-12-21T07:53:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.289085ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75802024-12-21T07:53:53.705ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75812024-12-21T07:53:53.705ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75822024-12-21T07:53:53.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.501659ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75832024-12-21T07:53:53.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
75842024-12-21T07:53:53.712ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75852024-12-21T07:53:53.712ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5164172-eb1c-4027-ba50-82d92405a86d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
75862024-12-21T07:53:53.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75872024-12-21T07:53:53.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
75882024-12-21T07:53:53.754ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.525939ms iteration = 16 status = {"physical_disks_added":0}
75892024-12-21T07:53:53.819ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75902024-12-21T07:53:53.820ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "51efba7e-e13e-4189-a10f-9d515adfb163", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
75912024-12-21T07:53:53.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75922024-12-21T07:53:53.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75932024-12-21T07:53:53.888ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.092438ms iteration = 14 status = {}
75942024-12-21T07:53:53.899ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75952024-12-21T07:53:53.901ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.926827ms iteration = 14 status = null
75962024-12-21T07:53:53.925ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75972024-12-21T07:53:53.925ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75982024-12-21T07:53:53.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9604fe84-3d4b-48a6-a17c-6b53a385f7c9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
75992024-12-21T07:53:53.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9604fe84-3d4b-48a6-a17c-6b53a385f7c9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76002024-12-21T07:53:53.958ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "99916c14-3920-45e3-ba4b-39b499b52b7f", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76012024-12-21T07:53:53.958ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "345ec137-54ae-41a2-ba6f-7173514b6fe6", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76022024-12-21T07:53:53.958ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76032024-12-21T07:53:53.958ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76042024-12-21T07:53:53.958ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76052024-12-21T07:53:53.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76062024-12-21T07:53:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76072024-12-21T07:53:53.960ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 378.779197ms iteration = 14 status = {}
76082024-12-21T07:53:53.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9604fe84-3d4b-48a6-a17c-6b53a385f7c9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76092024-12-21T07:53:53.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76102024-12-21T07:53:53.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76112024-12-21T07:53:53.992ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
76122024-12-21T07:53:53.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76132024-12-21T07:53:53.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76142024-12-21T07:53:54.000ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
76152024-12-21T07:53:54.000ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76162024-12-21T07:53:54.000ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc6f0c95-eb49-49c4-b51e-fb9cec554d6a", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76172024-12-21T07:53:54.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76182024-12-21T07:53:54.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76192024-12-21T07:53:54.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76202024-12-21T07:53:54.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dd1f870-9981-4b78-b575-e272e3a3f617", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76212024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76222024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
76232024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76242024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76252024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76262024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76272024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76282024-12-21T07:53:54.002ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76292024-12-21T07:53:54.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76302024-12-21T07:53:54.003ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76312024-12-21T07:53:54.003ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76322024-12-21T07:53:54.003ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
76332024-12-21T07:53:54.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76342024-12-21T07:53:54.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76352024-12-21T07:53:54.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76362024-12-21T07:53:54.005ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76372024-12-21T07:53:54.005ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7f52ce-d3a7-4637-9203-612653e8b0e8", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76382024-12-21T07:53:54.005ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76392024-12-21T07:53:54.005ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f995285b-0e4b-4858-8833-c9db189d366d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76402024-12-21T07:53:54.005ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
76412024-12-21T07:53:54.005ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76422024-12-21T07:53:54.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76432024-12-21T07:53:54.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76442024-12-21T07:53:54.009ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76452024-12-21T07:53:54.009ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76462024-12-21T07:53:54.011ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3d635979-6b94-401d-8955-348514532b68", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76472024-12-21T07:53:54.013ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.899328ms iteration = 14 status = {}
76482024-12-21T07:53:54.157ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76c5fc4c-8240-4283-a335-87b703d9c056", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76492024-12-21T07:53:54.157ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
76502024-12-21T07:53:54.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76512024-12-21T07:53:54.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4823aaf0-0b4a-4f29-ad95-abf530f2ebf4", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
76522024-12-21T07:53:54.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76532024-12-21T07:53:54.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76542024-12-21T07:53:54.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76552024-12-21T07:53:54.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76562024-12-21T07:53:54.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76572024-12-21T07:53:54.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76582024-12-21T07:53:54.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76592024-12-21T07:53:54.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76602024-12-21T07:53:54.173ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 592.31547ms iteration = 14 status = {}
76612024-12-21T07:53:54.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c25969e2-d9e7-4ad3-a4e3-a55d63037d52 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76622024-12-21T07:53:54.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c25969e2-d9e7-4ad3-a4e3-a55d63037d52 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76632024-12-21T07:53:54.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c25969e2-d9e7-4ad3-a4e3-a55d63037d52 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76642024-12-21T07:53:55.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 863 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = bbd39228-dac7-4913-a53d-8b4d2f7bcea3 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
76652024-12-21T07:53:56.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af02f161-836d-4881-8bb0-c5b221be942a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76662024-12-21T07:53:56.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af02f161-836d-4881-8bb0-c5b221be942a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76672024-12-21T07:53:56.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af02f161-836d-4881-8bb0-c5b221be942a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76682024-12-21T07:53:57.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b91b4b89-26ac-4192-9f98-3dc3074cd7a2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76692024-12-21T07:53:57.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b91b4b89-26ac-4192-9f98-3dc3074cd7a2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76702024-12-21T07:53:57.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b91b4b89-26ac-4192-9f98-3dc3074cd7a2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76712024-12-21T07:53:58.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b81e6ed-1c1c-4164-97cf-0c2a22d1551b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76722024-12-21T07:53:58.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b81e6ed-1c1c-4164-97cf-0c2a22d1551b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76732024-12-21T07:53:58.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0b81e6ed-1c1c-4164-97cf-0c2a22d1551b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76742024-12-21T07:53:59.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea2fb63e-ed27-402b-b87b-059beef2b614 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76752024-12-21T07:53:59.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea2fb63e-ed27-402b-b87b-059beef2b614 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76762024-12-21T07:53:59.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea2fb63e-ed27-402b-b87b-059beef2b614 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76772024-12-21T07:54:00.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0dbd676-6a66-41b9-af85-af6b47149e16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76782024-12-21T07:54:00.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0dbd676-6a66-41b9-af85-af6b47149e16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76792024-12-21T07:54:00.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c0dbd676-6a66-41b9-af85-af6b47149e16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76802024-12-21T07:54:01.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e35c590c-0dd8-4534-9c78-69bf110de851 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76812024-12-21T07:54:01.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e35c590c-0dd8-4534-9c78-69bf110de851 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76822024-12-21T07:54:01.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e35c590c-0dd8-4534-9c78-69bf110de851 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76832024-12-21T07:54:02.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fad1b2c-9df7-4a45-999d-9bef31dbc8ea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76842024-12-21T07:54:02.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fad1b2c-9df7-4a45-999d-9bef31dbc8ea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76852024-12-21T07:54:02.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fad1b2c-9df7-4a45-999d-9bef31dbc8ea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76862024-12-21T07:54:03.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b74a86ff-f6d7-4bac-ad71-b696ae11f886 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76872024-12-21T07:54:03.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b74a86ff-f6d7-4bac-ad71-b696ae11f886 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76882024-12-21T07:54:03.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b74a86ff-f6d7-4bac-ad71-b696ae11f886 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
76892024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
76902024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76912024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
76922024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76932024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76942024-12-21T07:54:03.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76952024-12-21T07:54:03.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-12-21T07:54:03.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76972024-12-21T07:54:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76982024-12-21T07:54:03.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76992024-12-21T07:54:03.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77002024-12-21T07:54:03.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77012024-12-21T07:54:03.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77022024-12-21T07:54:03.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77032024-12-21T07:54:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77042024-12-21T07:54:03.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
77052024-12-21T07:54:03.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77062024-12-21T07:54:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77072024-12-21T07:54:03.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
77082024-12-21T07:54:03.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.215439ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
77092024-12-21T07:54:03.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.738657ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77102024-12-21T07:54:04.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38c80e2f-63d2-43f6-95d4-a08366d60c25 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77112024-12-21T07:54:04.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38c80e2f-63d2-43f6-95d4-a08366d60c25 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77122024-12-21T07:54:04.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38c80e2f-63d2-43f6-95d4-a08366d60c25 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77132024-12-21T07:54:05.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 49be1af9-b434-4b89-8369-0a780b387bc1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77142024-12-21T07:54:05.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 49be1af9-b434-4b89-8369-0a780b387bc1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77152024-12-21T07:54:05.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 49be1af9-b434-4b89-8369-0a780b387bc1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77162024-12-21T07:54:05.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = bab7fd27-74f8-4a47-9c3d-21a5e74e6210 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
77172024-12-21T07:54:06.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46d7854a-479f-43b1-aae1-cbe5f582af53 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77182024-12-21T07:54:06.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46d7854a-479f-43b1-aae1-cbe5f582af53 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77192024-12-21T07:54:06.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46d7854a-479f-43b1-aae1-cbe5f582af53 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77202024-12-21T07:54:07.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e4260cc-20af-46e8-9f3b-1a45aa8b4d36 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77212024-12-21T07:54:07.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e4260cc-20af-46e8-9f3b-1a45aa8b4d36 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77222024-12-21T07:54:07.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e4260cc-20af-46e8-9f3b-1a45aa8b4d36 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77232024-12-21T07:54:08.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0207f39-19b1-4c6a-bc16-e947ef31408a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77242024-12-21T07:54:08.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0207f39-19b1-4c6a-bc16-e947ef31408a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77252024-12-21T07:54:08.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0207f39-19b1-4c6a-bc16-e947ef31408a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77262024-12-21T07:54:09.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 663996ec-5c43-459a-85f9-3fb7e091f844 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77272024-12-21T07:54:09.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 663996ec-5c43-459a-85f9-3fb7e091f844 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77282024-12-21T07:54:09.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 663996ec-5c43-459a-85f9-3fb7e091f844 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77292024-12-21T07:54:10.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbb090f7-7b15-4978-bf49-f30bf9fafa43 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77302024-12-21T07:54:10.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbb090f7-7b15-4978-bf49-f30bf9fafa43 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77312024-12-21T07:54:10.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dbb090f7-7b15-4978-bf49-f30bf9fafa43 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77322024-12-21T07:54:11.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b0c5d24-3313-4f9e-9c2b-4c6cb5900dcb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77332024-12-21T07:54:11.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b0c5d24-3313-4f9e-9c2b-4c6cb5900dcb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77342024-12-21T07:54:11.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b0c5d24-3313-4f9e-9c2b-4c6cb5900dcb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77352024-12-21T07:54:12.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82d0d6e1-c7e0-4d4e-a58a-4141528ca36a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77362024-12-21T07:54:12.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82d0d6e1-c7e0-4d4e-a58a-4141528ca36a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77372024-12-21T07:54:12.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 82d0d6e1-c7e0-4d4e-a58a-4141528ca36a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77382024-12-21T07:54:13.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdc46a42-c5b2-4c15-90e4-30da173ed5d7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77392024-12-21T07:54:13.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdc46a42-c5b2-4c15-90e4-30da173ed5d7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77402024-12-21T07:54:13.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bdc46a42-c5b2-4c15-90e4-30da173ed5d7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77412024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
77422024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
77432024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77442024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77452024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77462024-12-21T07:54:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77472024-12-21T07:54:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77482024-12-21T07:54:13.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77492024-12-21T07:54:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77502024-12-21T07:54:13.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.045039ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77512024-12-21T07:54:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77522024-12-21T07:54:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77532024-12-21T07:54:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77542024-12-21T07:54:13.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77552024-12-21T07:54:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77562024-12-21T07:54:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572024-12-21T07:54:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
77582024-12-21T07:54:13.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77592024-12-21T07:54:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77602024-12-21T07:54:13.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
77612024-12-21T07:54:13.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.55578ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
77622024-12-21T07:54:14.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b709dec8-37da-442e-833c-09c59872c269 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77632024-12-21T07:54:14.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b709dec8-37da-442e-833c-09c59872c269 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77642024-12-21T07:54:14.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b709dec8-37da-442e-833c-09c59872c269 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77652024-12-21T07:54:15.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a09b1c1d-f8af-44e5-b60b-61abd02a3e5a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77662024-12-21T07:54:15.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a09b1c1d-f8af-44e5-b60b-61abd02a3e5a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77672024-12-21T07:54:15.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a09b1c1d-f8af-44e5-b60b-61abd02a3e5a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77682024-12-21T07:54:15.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 777 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 2b4d4ca6-3608-4edc-855c-53b79f72466b response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
77692024-12-21T07:54:16.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20dbcfb0-bccc-402d-9f94-bf76587ffc97 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77702024-12-21T07:54:16.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20dbcfb0-bccc-402d-9f94-bf76587ffc97 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77712024-12-21T07:54:16.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20dbcfb0-bccc-402d-9f94-bf76587ffc97 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77722024-12-21T07:54:17.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2f58ec2-aa37-436b-80d2-e74ede718658 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77732024-12-21T07:54:17.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2f58ec2-aa37-436b-80d2-e74ede718658 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77742024-12-21T07:54:17.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a2f58ec2-aa37-436b-80d2-e74ede718658 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77752024-12-21T07:54:18.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae355b1c-a258-4586-a0a4-d6e5f088ce63 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77762024-12-21T07:54:18.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae355b1c-a258-4586-a0a4-d6e5f088ce63 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77772024-12-21T07:54:18.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae355b1c-a258-4586-a0a4-d6e5f088ce63 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77782024-12-21T07:54:19.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eee4e11c-dc29-4876-956d-73c22d61fe80 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77792024-12-21T07:54:19.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eee4e11c-dc29-4876-956d-73c22d61fe80 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77802024-12-21T07:54:19.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eee4e11c-dc29-4876-956d-73c22d61fe80 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77812024-12-21T07:54:20.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae41bd07-c336-4fc8-9e65-9e0f3163519d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77822024-12-21T07:54:20.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae41bd07-c336-4fc8-9e65-9e0f3163519d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77832024-12-21T07:54:20.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae41bd07-c336-4fc8-9e65-9e0f3163519d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77842024-12-21T07:54:20.886ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:34932
77852024-12-21T07:54:20.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 74577e36-8584-42b8-a859-9c473d15902a roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77862024-12-21T07:54:20.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 74577e36-8584-42b8-a859-9c473d15902a resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77872024-12-21T07:54:20.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 74577e36-8584-42b8-a859-9c473d15902a response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77882024-12-21T07:54:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d23b1c13-3be3-4896-b7a9-584ce31cb857 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77892024-12-21T07:54:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d23b1c13-3be3-4896-b7a9-584ce31cb857 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77902024-12-21T07:54:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d23b1c13-3be3-4896-b7a9-584ce31cb857 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77912024-12-21T07:54:21.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4544830c-0883-4f60-a974-a994d05da875 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77922024-12-21T07:54:21.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4544830c-0883-4f60-a974-a994d05da875 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77932024-12-21T07:54:21.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4544830c-0883-4f60-a974-a994d05da875 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77942024-12-21T07:54:22.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e7ed257-d974-4905-9332-f536f73b71e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77952024-12-21T07:54:22.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e7ed257-d974-4905-9332-f536f73b71e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77962024-12-21T07:54:22.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e7ed257-d974-4905-9332-f536f73b71e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
77972024-12-21T07:54:23.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
77982024-12-21T07:54:23.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77992024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
78002024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78012024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
78022024-12-21T07:54:23.582ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78032024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78042024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78052024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78062024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
78072024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
78082024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78092024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78102024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78112024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78122024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78132024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78142024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78152024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
78162024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
78172024-12-21T07:54:23.582ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78182024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78192024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
78202024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78212024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78222024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78232024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78242024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78252024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
78262024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78272024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
78282024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
78292024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78302024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78312024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
78322024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78332024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
78342024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
78352024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
78362024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
78372024-12-21T07:54:23.582ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
78382024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.49\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
78392024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
78402024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
78412024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78422024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
78432024-12-21T07:54:23.582ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:44:23.582329787 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
78442024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
78452024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
78462024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78472024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78482024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
78492024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78502024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78512024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
78522024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78532024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78542024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
78552024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
78562024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78572024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78582024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78592024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78602024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78612024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78622024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78632024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78642024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78652024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78662024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78672024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78682024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78692024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78702024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78712024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78722024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78732024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78742024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78752024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78762024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
78772024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78782024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78792024-12-21T07:54:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78802024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78812024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78822024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78832024-12-21T07:54:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 532121980 } })
78842024-12-21T07:54:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 532167991 } })
78852024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
78862024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.258661ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
78872024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
78882024-12-21T07:54:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.426084ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
78892024-12-21T07:54:23.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78902024-12-21T07:54:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78912024-12-21T07:54:23.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 539729211 } })
78922024-12-21T07:54:23.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78932024-12-21T07:54:23.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78942024-12-21T07:54:23.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78952024-12-21T07:54:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.695768ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78962024-12-21T07:54:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78972024-12-21T07:54:23.595ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78982024-12-21T07:54:23.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5ac527-e1f2-474e-8f97-8ffc61d930bf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
78992024-12-21T07:54:23.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5ac527-e1f2-474e-8f97-8ffc61d930bf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
79002024-12-21T07:54:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79012024-12-21T07:54:23.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79022024-12-21T07:54:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79032024-12-21T07:54:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79042024-12-21T07:54:23.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79052024-12-21T07:54:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79062024-12-21T07:54:23.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79072024-12-21T07:54:23.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082024-12-21T07:54:23.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79092024-12-21T07:54:23.605ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.786128ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
79102024-12-21T07:54:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79112024-12-21T07:54:23.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 556316665 } })
79122024-12-21T07:54:23.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:44:23.582329787 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
79132024-12-21T07:54:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.991339ms iteration = 8 status = {"expiration":"2024-12-21T07:44:23.582329787Z","pruned":[]}
79142024-12-21T07:54:23.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
79152024-12-21T07:54:23.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79162024-12-21T07:54:23.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79172024-12-21T07:54:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79182024-12-21T07:54:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79192024-12-21T07:54:23.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79202024-12-21T07:54:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79212024-12-21T07:54:23.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed5ac527-e1f2-474e-8f97-8ffc61d930bf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
79222024-12-21T07:54:23.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79232024-12-21T07:54:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79242024-12-21T07:54:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79252024-12-21T07:54:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79262024-12-21T07:54:23.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79272024-12-21T07:54:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79282024-12-21T07:54:23.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79292024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.021422ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
79302024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79312024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79322024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79332024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79342024-12-21T07:54:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79352024-12-21T07:54:23.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79362024-12-21T07:54:23.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372024-12-21T07:54:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79382024-12-21T07:54:23.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79392024-12-21T07:54:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79402024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
79412024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79422024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79432024-12-21T07:54:23.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79442024-12-21T07:54:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79452024-12-21T07:54:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.120223ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
79462024-12-21T07:54:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.948794ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79472024-12-21T07:54:23.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79482024-12-21T07:54:23.678ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79492024-12-21T07:54:23.679ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79502024-12-21T07:54:23.679ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 96.894852ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79512024-12-21T07:54:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79522024-12-21T07:54:23.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79532024-12-21T07:54:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79542024-12-21T07:54:23.681ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.977327ms iteration = 17 status = {"physical_disks_added":0}
79552024-12-21T07:54:23.685ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 634523597 } })
79562024-12-21T07:54:23.685ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
79572024-12-21T07:54:23.686ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79582024-12-21T07:54:23.686ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79592024-12-21T07:54:23.686ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79602024-12-21T07:54:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.94279ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79612024-12-21T07:54:23.687ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79622024-12-21T07:54:23.687ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79632024-12-21T07:54:23.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79642024-12-21T07:54:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79652024-12-21T07:54:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79662024-12-21T07:54:23.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79672024-12-21T07:54:23.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79682024-12-21T07:54:23.694ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79692024-12-21T07:54:23.694ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79702024-12-21T07:54:23.694ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79712024-12-21T07:54:23.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79722024-12-21T07:54:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79732024-12-21T07:54:23.696ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79742024-12-21T07:54:23.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79752024-12-21T07:54:23.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79762024-12-21T07:54:23.699ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79772024-12-21T07:54:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79782024-12-21T07:54:23.700ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79792024-12-21T07:54:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.061955ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79802024-12-21T07:54:23.701ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79812024-12-21T07:54:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79822024-12-21T07:54:23.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79832024-12-21T07:54:23.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79842024-12-21T07:54:23.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79852024-12-21T07:54:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79862024-12-21T07:54:23.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79872024-12-21T07:54:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79882024-12-21T07:54:23.704ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79892024-12-21T07:54:23.705ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
79902024-12-21T07:54:23.705ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.760115ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
79912024-12-21T07:54:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79922024-12-21T07:54:23.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79932024-12-21T07:54:23.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79942024-12-21T07:54:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79952024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79962024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79972024-12-21T07:54:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79982024-12-21T07:54:23.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79992024-12-21T07:54:23.727ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80002024-12-21T07:54:23.728ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "097299b8-a348-44bc-b39b-89ddd7a344e7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
80012024-12-21T07:54:23.728ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80022024-12-21T07:54:23.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80032024-12-21T07:54:23.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80042024-12-21T07:54:23.742ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80052024-12-21T07:54:23.742ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "633ccbcd-d617-4c50-b925-60d710a84bd1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
80062024-12-21T07:54:23.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80072024-12-21T07:54:23.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80082024-12-21T07:54:23.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80092024-12-21T07:54:23.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80102024-12-21T07:54:23.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80112024-12-21T07:54:23.745ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80122024-12-21T07:54:23.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80132024-12-21T07:54:23.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80142024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
80152024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80162024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80172024-12-21T07:54:23.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80182024-12-21T07:54:23.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 174.621955ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80192024-12-21T07:54:23.758ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80202024-12-21T07:54:23.758ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
80212024-12-21T07:54:23.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80222024-12-21T07:54:23.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80232024-12-21T07:54:23.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80242024-12-21T07:54:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80252024-12-21T07:54:23.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80262024-12-21T07:54:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80272024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 183.704051ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80282024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
80292024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80302024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
80312024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 183.862094ms iteration = 8 status = {"generation":2}
80322024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 184.28292ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80332024-12-21T07:54:23.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80342024-12-21T07:54:23.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80352024-12-21T07:54:23.776ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80362024-12-21T07:54:23.776ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80372024-12-21T07:54:23.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80382024-12-21T07:54:23.776ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80392024-12-21T07:54:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80402024-12-21T07:54:23.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80412024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80422024-12-21T07:54:23.786ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80432024-12-21T07:54:23.786ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80442024-12-21T07:54:23.786ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80452024-12-21T07:54:23.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80462024-12-21T07:54:23.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80472024-12-21T07:54:23.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80482024-12-21T07:54:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80492024-12-21T07:54:23.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80502024-12-21T07:54:23.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80512024-12-21T07:54:23.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80522024-12-21T07:54:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80532024-12-21T07:54:23.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80542024-12-21T07:54:23.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80552024-12-21T07:54:23.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80562024-12-21T07:54:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80572024-12-21T07:54:23.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
80582024-12-21T07:54:23.804ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80592024-12-21T07:54:23.805ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d708304a-90aa-4aa3-8695-4ac227bbad66", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
80602024-12-21T07:54:23.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80612024-12-21T07:54:23.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
80622024-12-21T07:54:23.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80632024-12-21T07:54:23.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
80642024-12-21T07:54:23.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80652024-12-21T07:54:23.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80662024-12-21T07:54:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 234.769807ms iteration = 15 status = 0
80672024-12-21T07:54:23.829ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80682024-12-21T07:54:23.829ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80692024-12-21T07:54:23.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 247.631367ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80702024-12-21T07:54:23.845ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80712024-12-21T07:54:23.845ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80722024-12-21T07:54:23.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80732024-12-21T07:54:23.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80742024-12-21T07:54:23.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80752024-12-21T07:54:23.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80762024-12-21T07:54:23.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80772024-12-21T07:54:23.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80782024-12-21T07:54:23.853ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80792024-12-21T07:54:23.853ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80802024-12-21T07:54:23.853ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
80812024-12-21T07:54:23.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 271.809682ms iteration = 8 status = {"generation":1}
80822024-12-21T07:54:23.854ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80832024-12-21T07:54:23.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.694347ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80842024-12-21T07:54:23.856ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
80852024-12-21T07:54:23.856ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 274.315555ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80862024-12-21T07:54:23.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80872024-12-21T07:54:23.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80882024-12-21T07:54:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80892024-12-21T07:54:23.905ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80902024-12-21T07:54:23.906ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a7e4edf-58ba-42a7-aa2e-4a62994a7d24", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
80912024-12-21T07:54:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80922024-12-21T07:54:23.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80932024-12-21T07:54:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80942024-12-21T07:54:23.907ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80952024-12-21T07:54:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80962024-12-21T07:54:23.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80972024-12-21T07:54:23.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80982024-12-21T07:54:23.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80992024-12-21T07:54:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81002024-12-21T07:54:23.914ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81012024-12-21T07:54:23.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4dceff9f-ef52-49a4-8f69-6d5ce73ede4f", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81022024-12-21T07:54:23.915ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81032024-12-21T07:54:23.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "42d508cd-c747-4fd1-ad31-d45deda82ebb", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81042024-12-21T07:54:23.917ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81052024-12-21T07:54:23.919ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81062024-12-21T07:54:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.712395ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81072024-12-21T07:54:23.927ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.461775ms iteration = 15 status = {}
81082024-12-21T07:54:23.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81092024-12-21T07:54:23.958ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81102024-12-21T07:54:23.958ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81112024-12-21T07:54:23.958ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f337ef9-c2bb-4bcb-afe6-383234b5b81e", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
81122024-12-21T07:54:23.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81132024-12-21T07:54:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81142024-12-21T07:54:23.960ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 378.98837ms iteration = 15 status = null
81152024-12-21T07:54:23.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81162024-12-21T07:54:23.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e90e21a3-c550-49b7-8b3f-c3a924ef7d1e", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81172024-12-21T07:54:23.989ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81182024-12-21T07:54:23.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "61ab46e4-c014-4a98-9e06-2f990ada3a94", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81192024-12-21T07:54:23.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81202024-12-21T07:54:23.991ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4cf0a961-c4bb-4431-af79-96601bc1c84f", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81212024-12-21T07:54:23.991ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81222024-12-21T07:54:23.993ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81232024-12-21T07:54:23.993ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 411.094251ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81242024-12-21T07:54:24.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81252024-12-21T07:54:24.004ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81262024-12-21T07:54:24.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81272024-12-21T07:54:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81282024-12-21T07:54:24.031ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
81292024-12-21T07:54:24.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81302024-12-21T07:54:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81312024-12-21T07:54:24.055ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81322024-12-21T07:54:24.058ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3e14a7bd-54c4-46c1-ad88-c78d9009130f", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81332024-12-21T07:54:24.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81342024-12-21T07:54:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81352024-12-21T07:54:24.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81362024-12-21T07:54:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81372024-12-21T07:54:24.061ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85b79b0a-7d81-4590-b732-02cefb919458", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81382024-12-21T07:54:24.061ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81392024-12-21T07:54:24.061ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81402024-12-21T07:54:24.061ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81412024-12-21T07:54:24.063ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.483268ms iteration = 15 status = {}
81422024-12-21T07:54:24.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81432024-12-21T07:54:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81442024-12-21T07:54:24.065ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81452024-12-21T07:54:24.065ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dedf045e-eec8-40f7-8e73-719194615ec7", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81462024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81472024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
81482024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81492024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81502024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81512024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81522024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81532024-12-21T07:54:24.065ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81542024-12-21T07:54:24.066ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81552024-12-21T07:54:24.066ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81562024-12-21T07:54:24.066ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
81572024-12-21T07:54:24.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81582024-12-21T07:54:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81592024-12-21T07:54:24.067ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81602024-12-21T07:54:24.067ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81612024-12-21T07:54:24.067ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42f296ba-59d7-4b18-aae1-849e63c52396", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81622024-12-21T07:54:24.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81632024-12-21T07:54:24.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a5579a4-0cd6-4de7-8fdf-a6990d06751d", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81642024-12-21T07:54:24.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81652024-12-21T07:54:24.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "602dffe6-d542-4936-817c-49686beb05ea", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81662024-12-21T07:54:24.068ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
81672024-12-21T07:54:24.068ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81682024-12-21T07:54:24.069ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 487.753456ms iteration = 15 status = {}
81692024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bc14075b-3048-494c-b588-5003c148cc7b", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81702024-12-21T07:54:24.162ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
81712024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81722024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e3fdd19-ae28-43aa-a0a8-35c56bccbba4", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
81732024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81742024-12-21T07:54:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81752024-12-21T07:54:24.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81762024-12-21T07:54:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81772024-12-21T07:54:24.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81782024-12-21T07:54:24.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81792024-12-21T07:54:24.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81802024-12-21T07:54:24.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81812024-12-21T07:54:24.179ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 597.550589ms iteration = 15 status = {}
81822024-12-21T07:54:24.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4011d75-4b37-4b5f-bf87-afab149cab1a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81832024-12-21T07:54:24.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4011d75-4b37-4b5f-bf87-afab149cab1a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81842024-12-21T07:54:24.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e4011d75-4b37-4b5f-bf87-afab149cab1a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81852024-12-21T07:54:25.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8f58f97-6842-448a-9877-c220cbbeeb41 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81862024-12-21T07:54:25.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8f58f97-6842-448a-9877-c220cbbeeb41 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81872024-12-21T07:54:25.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8f58f97-6842-448a-9877-c220cbbeeb41 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81882024-12-21T07:54:25.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 93e898ae-d98e-4903-b63e-ba8d135c418e response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
81892024-12-21T07:54:26.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c35ee819-83b7-48df-8a5a-02e5fb9c9663 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81902024-12-21T07:54:26.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c35ee819-83b7-48df-8a5a-02e5fb9c9663 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81912024-12-21T07:54:26.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c35ee819-83b7-48df-8a5a-02e5fb9c9663 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81922024-12-21T07:54:27.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a108f663-6d1d-442d-b06d-7a9bb705e366 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81932024-12-21T07:54:27.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a108f663-6d1d-442d-b06d-7a9bb705e366 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81942024-12-21T07:54:27.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a108f663-6d1d-442d-b06d-7a9bb705e366 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81952024-12-21T07:54:28.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9721dd02-7248-4e97-a6b6-d296508f80d6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81962024-12-21T07:54:28.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9721dd02-7248-4e97-a6b6-d296508f80d6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81972024-12-21T07:54:28.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9721dd02-7248-4e97-a6b6-d296508f80d6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81982024-12-21T07:54:29.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8fb801a3-afa3-4626-9a45-eedf05e1968e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
81992024-12-21T07:54:29.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8fb801a3-afa3-4626-9a45-eedf05e1968e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82002024-12-21T07:54:29.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8fb801a3-afa3-4626-9a45-eedf05e1968e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82012024-12-21T07:54:30.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdd5ad4e-a73a-4a07-8470-9add798443ff roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82022024-12-21T07:54:30.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdd5ad4e-a73a-4a07-8470-9add798443ff resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82032024-12-21T07:54:30.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fdd5ad4e-a73a-4a07-8470-9add798443ff response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82042024-12-21T07:54:31.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3165b1b-3d9f-43e2-9fa3-089680694ccc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82052024-12-21T07:54:31.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3165b1b-3d9f-43e2-9fa3-089680694ccc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82062024-12-21T07:54:31.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3165b1b-3d9f-43e2-9fa3-089680694ccc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82072024-12-21T07:54:32.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15690f3-3f47-4e86-9131-b08102d3a32b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82082024-12-21T07:54:32.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15690f3-3f47-4e86-9131-b08102d3a32b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82092024-12-21T07:54:32.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15690f3-3f47-4e86-9131-b08102d3a32b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82102024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
82112024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82122024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
82132024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82142024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82152024-12-21T07:54:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82162024-12-21T07:54:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172024-12-21T07:54:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82182024-12-21T07:54:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82192024-12-21T07:54:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82202024-12-21T07:54:33.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82212024-12-21T07:54:33.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82222024-12-21T07:54:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82232024-12-21T07:54:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
82242024-12-21T07:54:33.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82252024-12-21T07:54:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82262024-12-21T07:54:33.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
82272024-12-21T07:54:33.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.603578ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
82282024-12-21T07:54:33.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82292024-12-21T07:54:33.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82302024-12-21T07:54:33.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.152906ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82312024-12-21T07:54:33.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c40fe801-1cf8-42ff-8f64-dab98834a086 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82322024-12-21T07:54:33.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c40fe801-1cf8-42ff-8f64-dab98834a086 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82332024-12-21T07:54:33.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c40fe801-1cf8-42ff-8f64-dab98834a086 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82342024-12-21T07:54:34.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 795f72ae-a8b5-4db5-9598-598bd3a0ad37 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82352024-12-21T07:54:34.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 795f72ae-a8b5-4db5-9598-598bd3a0ad37 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82362024-12-21T07:54:34.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 795f72ae-a8b5-4db5-9598-598bd3a0ad37 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82372024-12-21T07:54:35.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 11a3e624-c060-4f74-ba2c-3673296921d3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82382024-12-21T07:54:35.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 11a3e624-c060-4f74-ba2c-3673296921d3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82392024-12-21T07:54:35.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 11a3e624-c060-4f74-ba2c-3673296921d3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82402024-12-21T07:54:35.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 173dc967-6d10-43c4-a9b5-2cf76ac6ec84 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
82412024-12-21T07:54:36.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10222b3b-9cc5-4d24-bea3-d03d3f01eab5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82422024-12-21T07:54:36.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10222b3b-9cc5-4d24-bea3-d03d3f01eab5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82432024-12-21T07:54:36.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10222b3b-9cc5-4d24-bea3-d03d3f01eab5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82442024-12-21T07:54:37.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02cf097e-9796-46d6-9dbc-0d249ac884f9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82452024-12-21T07:54:37.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02cf097e-9796-46d6-9dbc-0d249ac884f9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82462024-12-21T07:54:37.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02cf097e-9796-46d6-9dbc-0d249ac884f9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82472024-12-21T07:54:38.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 566138d2-b44f-4556-9f79-0647fa2d6599 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82482024-12-21T07:54:38.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 566138d2-b44f-4556-9f79-0647fa2d6599 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82492024-12-21T07:54:38.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 566138d2-b44f-4556-9f79-0647fa2d6599 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82502024-12-21T07:54:39.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1cb10edb-9c25-4893-947c-2c32b128eaff roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82512024-12-21T07:54:39.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1cb10edb-9c25-4893-947c-2c32b128eaff resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82522024-12-21T07:54:39.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1cb10edb-9c25-4893-947c-2c32b128eaff response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82532024-12-21T07:54:40.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a20a1e47-d2a3-41be-92fe-8fdc86db6188 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82542024-12-21T07:54:40.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a20a1e47-d2a3-41be-92fe-8fdc86db6188 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82552024-12-21T07:54:40.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a20a1e47-d2a3-41be-92fe-8fdc86db6188 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82562024-12-21T07:54:42.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fb50782d-914f-4f18-902e-584a0e728833 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82572024-12-21T07:54:42.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fb50782d-914f-4f18-902e-584a0e728833 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82582024-12-21T07:54:42.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fb50782d-914f-4f18-902e-584a0e728833 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82592024-12-21T07:54:43.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = daa03a61-ce7e-4ac2-8e3e-3b060ec0d327 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82602024-12-21T07:54:43.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = daa03a61-ce7e-4ac2-8e3e-3b060ec0d327 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82612024-12-21T07:54:43.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = daa03a61-ce7e-4ac2-8e3e-3b060ec0d327 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82622024-12-21T07:54:43.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
82632024-12-21T07:54:43.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82642024-12-21T07:54:43.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82652024-12-21T07:54:43.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82662024-12-21T07:54:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82672024-12-21T07:54:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82682024-12-21T07:54:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82692024-12-21T07:54:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82702024-12-21T07:54:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82712024-12-21T07:54:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82722024-12-21T07:54:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82732024-12-21T07:54:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82742024-12-21T07:54:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-12-21T07:54:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
82762024-12-21T07:54:43.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82772024-12-21T07:54:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82782024-12-21T07:54:43.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
82792024-12-21T07:54:43.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.154634ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
82802024-12-21T07:54:43.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82812024-12-21T07:54:43.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82822024-12-21T07:54:43.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.900435ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82832024-12-21T07:54:44.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abf96e76-764a-4e3e-a9ca-50ea9ddef0d4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82842024-12-21T07:54:44.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abf96e76-764a-4e3e-a9ca-50ea9ddef0d4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82852024-12-21T07:54:44.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = abf96e76-764a-4e3e-a9ca-50ea9ddef0d4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82862024-12-21T07:54:45.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2de264f0-f288-4795-a40b-8c0cefc6e90c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82872024-12-21T07:54:45.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2de264f0-f288-4795-a40b-8c0cefc6e90c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82882024-12-21T07:54:45.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2de264f0-f288-4795-a40b-8c0cefc6e90c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82892024-12-21T07:54:45.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 008ff220-5c68-4456-8e4c-a0f7d4755cb0 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
82902024-12-21T07:54:46.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 374beb5d-ce2b-4775-a2dc-c5aad72078ff roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82912024-12-21T07:54:46.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 374beb5d-ce2b-4775-a2dc-c5aad72078ff resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82922024-12-21T07:54:46.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 374beb5d-ce2b-4775-a2dc-c5aad72078ff response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82932024-12-21T07:54:47.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fde71e01-f18d-489f-9c06-3eea91fec113 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82942024-12-21T07:54:47.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fde71e01-f18d-489f-9c06-3eea91fec113 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82952024-12-21T07:54:47.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fde71e01-f18d-489f-9c06-3eea91fec113 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82962024-12-21T07:54:48.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f8651b2-ec32-4252-8b48-0d55ae55d21d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82972024-12-21T07:54:48.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f8651b2-ec32-4252-8b48-0d55ae55d21d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82982024-12-21T07:54:48.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f8651b2-ec32-4252-8b48-0d55ae55d21d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
82992024-12-21T07:54:49.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6721612-a49d-4c90-bb79-458c712cae48 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83002024-12-21T07:54:49.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6721612-a49d-4c90-bb79-458c712cae48 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83012024-12-21T07:54:49.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6721612-a49d-4c90-bb79-458c712cae48 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83022024-12-21T07:54:50.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23837e36-7d10-47e8-b84f-426a9855c1b1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83032024-12-21T07:54:50.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23837e36-7d10-47e8-b84f-426a9855c1b1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83042024-12-21T07:54:50.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 23837e36-7d10-47e8-b84f-426a9855c1b1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83052024-12-21T07:54:51.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cba79f6d-5ff3-48e3-9999-5762fe85889e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83062024-12-21T07:54:51.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cba79f6d-5ff3-48e3-9999-5762fe85889e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83072024-12-21T07:54:51.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cba79f6d-5ff3-48e3-9999-5762fe85889e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83082024-12-21T07:54:52.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d1cd962-7af8-4933-94eb-2a8c15baca4a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83092024-12-21T07:54:52.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d1cd962-7af8-4933-94eb-2a8c15baca4a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83102024-12-21T07:54:52.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d1cd962-7af8-4933-94eb-2a8c15baca4a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83112024-12-21T07:54:53.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffa83882-469a-4a47-8e46-45a206076ba3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83122024-12-21T07:54:53.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffa83882-469a-4a47-8e46-45a206076ba3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83132024-12-21T07:54:53.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ffa83882-469a-4a47-8e46-45a206076ba3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
83142024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
83152024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83162024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
83172024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
83182024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83192024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83202024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83212024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
83222024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
83232024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83242024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
83252024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83262024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83272024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
83282024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83292024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
83302024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
83312024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83322024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83332024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83342024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83352024-12-21T07:54:53.582ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83362024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83372024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
83382024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
83392024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83402024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83412024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
83422024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83432024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
83442024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83452024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
83462024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83472024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
83482024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83492024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83502024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83512024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83522024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83532024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83542024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83552024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83562024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83572024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83582024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83592024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83602024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83612024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83622024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83632024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83642024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83652024-12-21T07:54:53.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.057852ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
83662024-12-21T07:54:53.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83672024-12-21T07:54:53.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83682024-12-21T07:54:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.382732ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83692024-12-21T07:54:53.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 536909682 } })
83702024-12-21T07:54:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83712024-12-21T07:54:53.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83722024-12-21T07:54:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83732024-12-21T07:54:53.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83742024-12-21T07:54:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83752024-12-21T07:54:53.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83762024-12-21T07:54:53.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83772024-12-21T07:54:53.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83782024-12-21T07:54:53.594ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83792024-12-21T07:54:53.594ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83802024-12-21T07:54:53.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83812024-12-21T07:54:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83822024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83832024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83842024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83852024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83862024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83872024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83882024-12-21T07:54:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83892024-12-21T07:54:53.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83902024-12-21T07:54:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83912024-12-21T07:54:53.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83922024-12-21T07:54:53.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83932024-12-21T07:54:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83942024-12-21T07:54:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83952024-12-21T07:54:53.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83962024-12-21T07:54:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83972024-12-21T07:54:53.603ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83982024-12-21T07:54:53.603ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83992024-12-21T07:54:53.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84002024-12-21T07:54:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84012024-12-21T07:54:53.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 553451106 } })
84022024-12-21T07:54:53.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84032024-12-21T07:54:53.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
84042024-12-21T07:54:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052024-12-21T07:54:53.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84062024-12-21T07:54:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84072024-12-21T07:54:53.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84082024-12-21T07:54:53.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 557659898 } })
84092024-12-21T07:54:53.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
84102024-12-21T07:54:53.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112024-12-21T07:54:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84122024-12-21T07:54:53.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84132024-12-21T07:54:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84142024-12-21T07:54:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
84152024-12-21T07:54:53.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84162024-12-21T07:54:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84172024-12-21T07:54:53.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
84182024-12-21T07:54:53.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.71138ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
84192024-12-21T07:54:53.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202024-12-21T07:54:53.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.990883ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
84212024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84222024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84232024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84242024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84252024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84262024-12-21T07:54:53.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84272024-12-21T07:54:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84282024-12-21T07:54:53.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84292024-12-21T07:54:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84302024-12-21T07:54:53.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.607671ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84312024-12-21T07:54:53.647ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84322024-12-21T07:54:53.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.65692ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84332024-12-21T07:54:53.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84342024-12-21T07:54:53.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84352024-12-21T07:54:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84362024-12-21T07:54:53.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84372024-12-21T07:54:53.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84382024-12-21T07:54:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84392024-12-21T07:54:53.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84402024-12-21T07:54:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84412024-12-21T07:54:53.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84422024-12-21T07:54:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84432024-12-21T07:54:53.654ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84442024-12-21T07:54:53.654ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84452024-12-21T07:54:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 71.542367ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84462024-12-21T07:54:53.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84472024-12-21T07:54:53.674ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84482024-12-21T07:54:53.674ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c71cb1bc-83ba-4400-821e-35651fa8889c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84492024-12-21T07:54:53.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84502024-12-21T07:54:53.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84512024-12-21T07:54:53.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.067494ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84522024-12-21T07:54:53.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532024-12-21T07:54:53.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
84542024-12-21T07:54:53.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84552024-12-21T07:54:53.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84562024-12-21T07:54:53.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.578465ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84572024-12-21T07:54:53.691ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.4287ms iteration = 16 status = 0
84582024-12-21T07:54:53.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.13575ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84592024-12-21T07:54:53.715ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
84602024-12-21T07:54:53.715ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84612024-12-21T07:54:53.715ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4665cb45-9210-40cd-8324-bc645b97ed60", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84622024-12-21T07:54:53.715ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84632024-12-21T07:54:53.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
84642024-12-21T07:54:53.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84652024-12-21T07:54:53.719ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84662024-12-21T07:54:53.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c766b4c-10c7-4906-8703-386274d3941e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84672024-12-21T07:54:53.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84682024-12-21T07:54:53.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84692024-12-21T07:54:53.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84702024-12-21T07:54:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84712024-12-21T07:54:53.734ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.200063ms iteration = 18 status = {"physical_disks_added":0}
84722024-12-21T07:54:53.771ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84732024-12-21T07:54:53.772ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb75f1af-3861-4651-9f08-ed3d1fac5887", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84742024-12-21T07:54:53.774ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84752024-12-21T07:54:53.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84762024-12-21T07:54:53.820ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 237.923191ms iteration = 16 status = {}
84772024-12-21T07:54:53.890ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84782024-12-21T07:54:53.890ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84792024-12-21T07:54:53.893ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 310.547026ms iteration = 16 status = null
84802024-12-21T07:54:53.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84812024-12-21T07:54:53.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84822024-12-21T07:54:53.953ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
84832024-12-21T07:54:53.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84842024-12-21T07:54:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84852024-12-21T07:54:53.953ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae98502d-e569-499e-a34e-4c2e2d68c0d9", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84862024-12-21T07:54:53.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84872024-12-21T07:54:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84882024-12-21T07:54:53.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84892024-12-21T07:54:53.963ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0319e61b-9942-49cc-81ca-b7bb4649e477", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
84902024-12-21T07:54:53.963ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84912024-12-21T07:54:53.963ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
84922024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84932024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84942024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84952024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84962024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84972024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84982024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84992024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85002024-12-21T07:54:53.964ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
85012024-12-21T07:54:53.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85022024-12-21T07:54:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85032024-12-21T07:54:53.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85042024-12-21T07:54:53.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c9d4c8a-71c9-46ed-aed2-e29b1a0339a9", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85052024-12-21T07:54:53.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85062024-12-21T07:54:53.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "10fd6f0f-c995-4dfa-adb3-52019b98c89d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85072024-12-21T07:54:53.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
85082024-12-21T07:54:53.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85092024-12-21T07:54:53.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85102024-12-21T07:54:53.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85112024-12-21T07:54:53.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85122024-12-21T07:54:53.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85132024-12-21T07:54:53.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85142024-12-21T07:54:53.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85152024-12-21T07:54:53.994ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
85162024-12-21T07:54:53.994ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85172024-12-21T07:54:53.995ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7d4ff1dd-b7fb-4c67-ac7a-0065de19d2c7", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85182024-12-21T07:54:53.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85192024-12-21T07:54:53.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85202024-12-21T07:54:53.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85212024-12-21T07:54:53.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85222024-12-21T07:54:53.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85232024-12-21T07:54:54.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85242024-12-21T07:54:54.002ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85252024-12-21T07:54:54.002ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85262024-12-21T07:54:54.003ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c49aa3a1-ee2d-4acc-9385-6ffe160392ab", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85272024-12-21T07:54:54.005ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 422.432225ms iteration = 16 status = {}
85282024-12-21T07:54:54.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85292024-12-21T07:54:54.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85302024-12-21T07:54:54.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85312024-12-21T07:54:54.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85322024-12-21T07:54:54.103ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85332024-12-21T07:54:54.105ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d90da1bd-1571-480c-8e7b-67aea6e9a686", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85342024-12-21T07:54:54.105ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85352024-12-21T07:54:54.105ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85362024-12-21T07:54:54.105ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85372024-12-21T07:54:54.107ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.842892ms iteration = 16 status = {}
85382024-12-21T07:54:54.135ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0625b0e3-a5e6-4675-9bdc-90d27bb4c869", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85392024-12-21T07:54:54.135ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
85402024-12-21T07:54:54.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85412024-12-21T07:54:54.135ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ad77a29-e0b2-4dae-ab12-5d69c22611e1", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
85422024-12-21T07:54:54.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85432024-12-21T07:54:54.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85442024-12-21T07:54:54.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85452024-12-21T07:54:54.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85462024-12-21T07:54:54.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85472024-12-21T07:54:54.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85482024-12-21T07:54:54.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85492024-12-21T07:54:54.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85502024-12-21T07:54:54.150ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 567.923621ms iteration = 16 status = {}
85512024-12-21T07:54:54.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42bfabe6-9801-4f7d-b114-401e82f578df roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85522024-12-21T07:54:54.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42bfabe6-9801-4f7d-b114-401e82f578df resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85532024-12-21T07:54:54.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 42bfabe6-9801-4f7d-b114-401e82f578df response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85542024-12-21T07:54:55.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39a22f3c-3032-4104-95d1-6bdfa0c24f43 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85552024-12-21T07:54:55.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39a22f3c-3032-4104-95d1-6bdfa0c24f43 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85562024-12-21T07:54:55.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 39a22f3c-3032-4104-95d1-6bdfa0c24f43 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85572024-12-21T07:54:55.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = dc5c3e6b-c130-4ccb-81d1-1fb980954ad1 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
85582024-12-21T07:54:56.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ae49083-337f-41d7-a0bc-5f0e2732fcab roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85592024-12-21T07:54:56.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ae49083-337f-41d7-a0bc-5f0e2732fcab resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85602024-12-21T07:54:56.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ae49083-337f-41d7-a0bc-5f0e2732fcab response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85612024-12-21T07:54:57.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8c106c35-a6c7-4f8d-872b-0c1eee2efdce roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85622024-12-21T07:54:57.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8c106c35-a6c7-4f8d-872b-0c1eee2efdce resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85632024-12-21T07:54:57.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8c106c35-a6c7-4f8d-872b-0c1eee2efdce response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85642024-12-21T07:54:58.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 324e862b-de58-41bf-ac09-e209da7df500 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85652024-12-21T07:54:58.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 324e862b-de58-41bf-ac09-e209da7df500 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85662024-12-21T07:54:58.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 324e862b-de58-41bf-ac09-e209da7df500 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85672024-12-21T07:54:59.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ab8ee5b1-0380-4080-a171-e5ad86a1f635 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85682024-12-21T07:54:59.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ab8ee5b1-0380-4080-a171-e5ad86a1f635 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85692024-12-21T07:54:59.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ab8ee5b1-0380-4080-a171-e5ad86a1f635 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85702024-12-21T07:55:00.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f9986ba-bbce-41f7-95dd-bc4ba4273548 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85712024-12-21T07:55:00.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f9986ba-bbce-41f7-95dd-bc4ba4273548 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85722024-12-21T07:55:00.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4f9986ba-bbce-41f7-95dd-bc4ba4273548 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85732024-12-21T07:55:01.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fe0d1de-cdd8-41be-96d2-4bd309ef8289 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85742024-12-21T07:55:01.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fe0d1de-cdd8-41be-96d2-4bd309ef8289 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85752024-12-21T07:55:01.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1fe0d1de-cdd8-41be-96d2-4bd309ef8289 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85762024-12-21T07:55:02.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 682c56f4-a04b-4ae9-a743-db076c8733a3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85772024-12-21T07:55:02.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 682c56f4-a04b-4ae9-a743-db076c8733a3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85782024-12-21T07:55:02.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 682c56f4-a04b-4ae9-a743-db076c8733a3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85792024-12-21T07:55:03.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5189a491-ad53-4923-97dd-84d479a17e2b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85802024-12-21T07:55:03.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5189a491-ad53-4923-97dd-84d479a17e2b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85812024-12-21T07:55:03.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5189a491-ad53-4923-97dd-84d479a17e2b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
85822024-12-21T07:55:03.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
85832024-12-21T07:55:03.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
85842024-12-21T07:55:03.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85852024-12-21T07:55:03.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85862024-12-21T07:55:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85872024-12-21T07:55:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85882024-12-21T07:55:03.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85892024-12-21T07:55:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85902024-12-21T07:55:03.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85912024-12-21T07:55:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85922024-12-21T07:55:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85932024-12-21T07:55:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85942024-12-21T07:55:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85952024-12-21T07:55:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85962024-12-21T07:55:03.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85972024-12-21T07:55:03.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
85982024-12-21T07:55:03.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85992024-12-21T07:55:03.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86002024-12-21T07:55:03.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
86012024-12-21T07:55:03.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.227976ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
86022024-12-21T07:55:03.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.680996ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86032024-12-21T07:55:04.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2ea8a183-430e-4a0c-bdac-9e90e05f9c85 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86042024-12-21T07:55:04.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2ea8a183-430e-4a0c-bdac-9e90e05f9c85 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86052024-12-21T07:55:04.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2ea8a183-430e-4a0c-bdac-9e90e05f9c85 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86062024-12-21T07:55:05.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fd62288-badc-4822-96ec-b1123e0968ef roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86072024-12-21T07:55:05.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fd62288-badc-4822-96ec-b1123e0968ef resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86082024-12-21T07:55:05.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2fd62288-badc-4822-96ec-b1123e0968ef response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86092024-12-21T07:55:05.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7df55dae-b1a4-4536-86ed-2336b1aa5c1c roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
86102024-12-21T07:55:05.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7df55dae-b1a4-4536-86ed-2336b1aa5c1c resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
86112024-12-21T07:55:05.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7df55dae-b1a4-4536-86ed-2336b1aa5c1c response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
86122024-12-21T07:55:05.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 11221e78-9980-49f2-b5bc-ad36d7479bf1 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
86132024-12-21T07:55:05.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 11221e78-9980-49f2-b5bc-ad36d7479bf1 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
86142024-12-21T07:55:05.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 11221e78-9980-49f2-b5bc-ad36d7479bf1 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
86152024-12-21T07:55:05.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 163ab9d3-31a8-4b31-bd67-820c6553dc2e response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
86162024-12-21T07:55:06.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4194104b-b36d-4abb-830e-c800160c5539 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86172024-12-21T07:55:06.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4194104b-b36d-4abb-830e-c800160c5539 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86182024-12-21T07:55:06.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4194104b-b36d-4abb-830e-c800160c5539 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86192024-12-21T07:55:07.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 28f7a44e-7230-4d05-9646-08bd320af621 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86202024-12-21T07:55:07.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 28f7a44e-7230-4d05-9646-08bd320af621 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86212024-12-21T07:55:07.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 28f7a44e-7230-4d05-9646-08bd320af621 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86222024-12-21T07:55:08.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a919c52-49a1-499e-8928-cae2c8fe3fc2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86232024-12-21T07:55:08.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a919c52-49a1-499e-8928-cae2c8fe3fc2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86242024-12-21T07:55:08.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a919c52-49a1-499e-8928-cae2c8fe3fc2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86252024-12-21T07:55:09.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81eff5b1-a065-4b62-a173-22a265027a04 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86262024-12-21T07:55:09.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81eff5b1-a065-4b62-a173-22a265027a04 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86272024-12-21T07:55:09.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81eff5b1-a065-4b62-a173-22a265027a04 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86282024-12-21T07:55:10.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8ad2ad20-3545-43e4-a02e-7d1a25c7f5ea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86292024-12-21T07:55:10.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8ad2ad20-3545-43e4-a02e-7d1a25c7f5ea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86302024-12-21T07:55:10.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8ad2ad20-3545-43e4-a02e-7d1a25c7f5ea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86312024-12-21T07:55:11.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d2a6642-f610-4a54-95db-f21c8c5c8fbc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86322024-12-21T07:55:11.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d2a6642-f610-4a54-95db-f21c8c5c8fbc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86332024-12-21T07:55:11.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4d2a6642-f610-4a54-95db-f21c8c5c8fbc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86342024-12-21T07:55:12.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f0030d3-7e6d-4ed4-89ca-2ae6b3dc8e81 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86352024-12-21T07:55:12.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f0030d3-7e6d-4ed4-89ca-2ae6b3dc8e81 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86362024-12-21T07:55:12.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7f0030d3-7e6d-4ed4-89ca-2ae6b3dc8e81 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86372024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
86382024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86392024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
86402024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86412024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86422024-12-21T07:55:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86432024-12-21T07:55:13.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86442024-12-21T07:55:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86452024-12-21T07:55:13.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.335097ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86462024-12-21T07:55:13.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86472024-12-21T07:55:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86482024-12-21T07:55:13.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86492024-12-21T07:55:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86502024-12-21T07:55:13.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86512024-12-21T07:55:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86522024-12-21T07:55:13.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86532024-12-21T07:55:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
86542024-12-21T07:55:13.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86552024-12-21T07:55:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86562024-12-21T07:55:13.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
86572024-12-21T07:55:13.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.776914ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
86582024-12-21T07:55:13.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 776cae9c-a508-4c99-85e2-5e725d6e4ca3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86592024-12-21T07:55:13.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 776cae9c-a508-4c99-85e2-5e725d6e4ca3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86602024-12-21T07:55:13.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 776cae9c-a508-4c99-85e2-5e725d6e4ca3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86612024-12-21T07:55:14.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80bd622f-d676-4b8a-8d41-d81780fcfc24 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86622024-12-21T07:55:14.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80bd622f-d676-4b8a-8d41-d81780fcfc24 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86632024-12-21T07:55:14.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80bd622f-d676-4b8a-8d41-d81780fcfc24 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86642024-12-21T07:55:15.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fe0b04c-2d2c-415e-8366-c105d38b23e5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86652024-12-21T07:55:15.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fe0b04c-2d2c-415e-8366-c105d38b23e5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86662024-12-21T07:55:15.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fe0b04c-2d2c-415e-8366-c105d38b23e5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86672024-12-21T07:55:15.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 556 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 6b05e9ab-398b-4c30-90c9-b77727f76de7 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
86682024-12-21T07:55:16.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99db34d9-8e14-4576-9e4d-0b472f4c78b4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86692024-12-21T07:55:16.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99db34d9-8e14-4576-9e4d-0b472f4c78b4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86702024-12-21T07:55:16.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 99db34d9-8e14-4576-9e4d-0b472f4c78b4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86712024-12-21T07:55:17.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d2ac36f-273d-4953-8fa6-45e03adf0c1f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86722024-12-21T07:55:17.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d2ac36f-273d-4953-8fa6-45e03adf0c1f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86732024-12-21T07:55:17.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d2ac36f-273d-4953-8fa6-45e03adf0c1f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86742024-12-21T07:55:18.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fba4548a-3850-4dd6-95c7-8eac0c9ae655 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86752024-12-21T07:55:18.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fba4548a-3850-4dd6-95c7-8eac0c9ae655 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86762024-12-21T07:55:18.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fba4548a-3850-4dd6-95c7-8eac0c9ae655 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86772024-12-21T07:55:19.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c1ee64e-0067-4152-8d84-33b044465657 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86782024-12-21T07:55:19.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c1ee64e-0067-4152-8d84-33b044465657 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86792024-12-21T07:55:19.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c1ee64e-0067-4152-8d84-33b044465657 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86802024-12-21T07:55:20.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 613da4c9-1758-4269-92fb-9173f776b13d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86812024-12-21T07:55:20.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 613da4c9-1758-4269-92fb-9173f776b13d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86822024-12-21T07:55:20.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 613da4c9-1758-4269-92fb-9173f776b13d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86832024-12-21T07:55:21.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f2a9f54-3ecb-4688-aa56-3316dd4c6937 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86842024-12-21T07:55:21.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f2a9f54-3ecb-4688-aa56-3316dd4c6937 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86852024-12-21T07:55:21.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3f2a9f54-3ecb-4688-aa56-3316dd4c6937 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86862024-12-21T07:55:22.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 655afa33-172f-4ad4-9137-fb4ccc75651b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86872024-12-21T07:55:22.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 655afa33-172f-4ad4-9137-fb4ccc75651b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86882024-12-21T07:55:22.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 655afa33-172f-4ad4-9137-fb4ccc75651b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
86892024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
86902024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
86912024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86922024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
86932024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
86942024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86952024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
86962024-12-21T07:55:23.582ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86972024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
86982024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86992024-12-21T07:55:23.582ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:45:23.582768513 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87002024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87012024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87022024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87032024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87042024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87052024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87062024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
87072024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
87082024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
87092024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87102024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87112024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87122024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
87132024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87142024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
87152024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
87162024-12-21T07:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87172024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87182024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
87192024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87202024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87212024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87222024-12-21T07:55:23.583ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87232024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87242024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
87252024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87262024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
87272024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87282024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87292024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87302024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
87312024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87322024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87332024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87342024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87352024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87362024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
87372024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
87382024-12-21T07:55:23.583ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
87392024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
87402024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87412024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.391\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
87422024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87432024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
87442024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
87452024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87462024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87472024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
87482024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87492024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
87502024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87512024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87522024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87532024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87542024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87552024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87562024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87572024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87582024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87592024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87602024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87612024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87622024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87632024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87642024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87652024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87662024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87672024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87682024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87692024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87702024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87712024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87722024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87732024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87742024-12-21T07:55:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 532308024 } })
87752024-12-21T07:55:23.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 532316924 } })
87762024-12-21T07:55:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87772024-12-21T07:55:23.584ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
87782024-12-21T07:55:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.903693ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
87792024-12-21T07:55:23.584ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
87802024-12-21T07:55:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.893133ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
87812024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87822024-12-21T07:55:23.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87832024-12-21T07:55:23.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 539314584 } })
87842024-12-21T07:55:23.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
87852024-12-21T07:55:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87862024-12-21T07:55:23.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87872024-12-21T07:55:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87882024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87892024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87902024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87912024-12-21T07:55:23.594ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:45:23.582768513 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87922024-12-21T07:55:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.892164ms iteration = 9 status = {"expiration":"2024-12-21T07:45:23.582768513Z","pruned":[]}
87932024-12-21T07:55:23.595ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87942024-12-21T07:55:23.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87952024-12-21T07:55:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87962024-12-21T07:55:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87972024-12-21T07:55:23.598ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87982024-12-21T07:55:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87992024-12-21T07:55:23.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.328552ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88002024-12-21T07:55:23.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-12-21T07:55:23.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 554849940 } })
88022024-12-21T07:55:23.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88032024-12-21T07:55:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88042024-12-21T07:55:23.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88052024-12-21T07:55:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88062024-12-21T07:55:23.618ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 35.078551ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
88072024-12-21T07:55:23.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88082024-12-21T07:55:23.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88092024-12-21T07:55:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88102024-12-21T07:55:23.619ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88112024-12-21T07:55:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88122024-12-21T07:55:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88132024-12-21T07:55:23.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88142024-12-21T07:55:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88152024-12-21T07:55:23.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88162024-12-21T07:55:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88172024-12-21T07:55:23.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88182024-12-21T07:55:23.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88192024-12-21T07:55:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88202024-12-21T07:55:23.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 593382911 } })
88212024-12-21T07:55:23.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
88222024-12-21T07:55:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88232024-12-21T07:55:23.651ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88242024-12-21T07:55:23.651ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88252024-12-21T07:55:23.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88262024-12-21T07:55:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88272024-12-21T07:55:23.655ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88282024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88292024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88302024-12-21T07:55:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88312024-12-21T07:55:23.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88322024-12-21T07:55:23.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88332024-12-21T07:55:23.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88342024-12-21T07:55:23.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.448286ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
88352024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88362024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88372024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88382024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88392024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88402024-12-21T07:55:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88412024-12-21T07:55:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88422024-12-21T07:55:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88432024-12-21T07:55:23.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88442024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88452024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88462024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88472024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88482024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88492024-12-21T07:55:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88502024-12-21T07:55:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.894182ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88512024-12-21T07:55:23.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88522024-12-21T07:55:23.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88532024-12-21T07:55:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88542024-12-21T07:55:23.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88552024-12-21T07:55:23.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88562024-12-21T07:55:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88572024-12-21T07:55:23.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582024-12-21T07:55:23.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88592024-12-21T07:55:23.693ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88602024-12-21T07:55:23.693ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88612024-12-21T07:55:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 110.437545ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88622024-12-21T07:55:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88632024-12-21T07:55:23.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88642024-12-21T07:55:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88652024-12-21T07:55:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
88662024-12-21T07:55:23.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88672024-12-21T07:55:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88682024-12-21T07:55:23.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88692024-12-21T07:55:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88702024-12-21T07:55:23.702ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88712024-12-21T07:55:23.702ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88722024-12-21T07:55:23.702ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.294216ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88732024-12-21T07:55:23.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742024-12-21T07:55:23.707ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88752024-12-21T07:55:23.707ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88762024-12-21T07:55:23.707ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88772024-12-21T07:55:23.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88782024-12-21T07:55:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88792024-12-21T07:55:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 124.533826ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
88802024-12-21T07:55:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.730863ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88812024-12-21T07:55:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88822024-12-21T07:55:23.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88832024-12-21T07:55:23.713ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88842024-12-21T07:55:23.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 129.918199ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88852024-12-21T07:55:23.714ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88862024-12-21T07:55:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88872024-12-21T07:55:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88882024-12-21T07:55:23.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88892024-12-21T07:55:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88902024-12-21T07:55:23.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
88912024-12-21T07:55:23.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 136.330378ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88922024-12-21T07:55:23.723ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
88932024-12-21T07:55:23.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.775005ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
88942024-12-21T07:55:23.729ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88952024-12-21T07:55:23.729ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88962024-12-21T07:55:23.729ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.665596ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88972024-12-21T07:55:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.704401ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88982024-12-21T07:55:23.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88992024-12-21T07:55:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89002024-12-21T07:55:23.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89012024-12-21T07:55:23.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89022024-12-21T07:55:23.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89032024-12-21T07:55:23.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89042024-12-21T07:55:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89052024-12-21T07:55:23.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89062024-12-21T07:55:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89072024-12-21T07:55:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.769188ms iteration = 19 status = {"physical_disks_added":0}
89082024-12-21T07:55:23.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89092024-12-21T07:55:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89102024-12-21T07:55:23.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89112024-12-21T07:55:23.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89122024-12-21T07:55:23.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89132024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89142024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89152024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89162024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89172024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89182024-12-21T07:55:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89192024-12-21T07:55:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
89202024-12-21T07:55:23.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89212024-12-21T07:55:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89222024-12-21T07:55:23.753ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.376813ms iteration = 17 status = 0
89232024-12-21T07:55:23.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89242024-12-21T07:55:23.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
89252024-12-21T07:55:23.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89262024-12-21T07:55:23.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89272024-12-21T07:55:23.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89282024-12-21T07:55:23.776ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89292024-12-21T07:55:23.776ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89302024-12-21T07:55:23.776ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89312024-12-21T07:55:23.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89322024-12-21T07:55:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89332024-12-21T07:55:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89342024-12-21T07:55:23.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89352024-12-21T07:55:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89362024-12-21T07:55:23.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89372024-12-21T07:55:23.779ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89382024-12-21T07:55:23.779ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73b11fc9-f10e-4f9a-a7a5-a86e10c8a062", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
89392024-12-21T07:55:23.779ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89402024-12-21T07:55:23.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89412024-12-21T07:55:23.794ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
89422024-12-21T07:55:23.794ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 212.223509ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89432024-12-21T07:55:23.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
89442024-12-21T07:55:23.799ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89452024-12-21T07:55:23.799ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9cd4b94-346c-406e-ad63-2de03b0cfdfb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
89462024-12-21T07:55:23.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89472024-12-21T07:55:23.800ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
89482024-12-21T07:55:23.812ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89492024-12-21T07:55:23.812ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89502024-12-21T07:55:23.812ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40b82673-faab-45a2-9ff2-44a1d468de0b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
89512024-12-21T07:55:23.812ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89522024-12-21T07:55:23.814ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89532024-12-21T07:55:23.850ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89542024-12-21T07:55:23.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 267.165072ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89552024-12-21T07:55:23.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89562024-12-21T07:55:23.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89572024-12-21T07:55:23.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89582024-12-21T07:55:23.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d6667f37-458c-4ebc-ae0e-55d767919e74", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89592024-12-21T07:55:23.887ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89602024-12-21T07:55:23.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a14a0c44-4949-4031-b6e6-9c7335bbdb5e", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89612024-12-21T07:55:23.888ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89622024-12-21T07:55:23.890ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89632024-12-21T07:55:23.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.109627ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89642024-12-21T07:55:23.924ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89652024-12-21T07:55:23.924ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89662024-12-21T07:55:23.925ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf02f801-0e90-46f0-87a7-01171a5121d1", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
89672024-12-21T07:55:23.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89682024-12-21T07:55:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89692024-12-21T07:55:23.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89702024-12-21T07:55:23.927ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89712024-12-21T07:55:23.927ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "670e0023-c1b9-4667-8e51-f24da7a15cfe", "content-length": "1", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
89722024-12-21T07:55:23.927ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
89732024-12-21T07:55:23.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89742024-12-21T07:55:23.927ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89752024-12-21T07:55:23.927ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
89762024-12-21T07:55:23.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 344.910236ms iteration = 9 status = {"generation":2}
89772024-12-21T07:55:23.928ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89782024-12-21T07:55:23.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89792024-12-21T07:55:23.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 109dbdbe-2e64-41dd-9ba5-0fa18e1ec2df roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
89802024-12-21T07:55:23.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 109dbdbe-2e64-41dd-9ba5-0fa18e1ec2df resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
89812024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89822024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89832024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89842024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89852024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89862024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89872024-12-21T07:55:23.930ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.065999ms iteration = 17 status = null
89882024-12-21T07:55:23.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 109dbdbe-2e64-41dd-9ba5-0fa18e1ec2df response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
89892024-12-21T07:55:23.961ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89902024-12-21T07:55:23.961ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89912024-12-21T07:55:23.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89922024-12-21T07:55:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89932024-12-21T07:55:23.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89942024-12-21T07:55:23.966ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.193702ms iteration = 17 status = {}
89952024-12-21T07:55:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89962024-12-21T07:55:23.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89972024-12-21T07:55:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89982024-12-21T07:55:23.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90002024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90012024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
90022024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 387.042388ms iteration = 9 status = {"generation":1}
90032024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90042024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90052024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90062024-12-21T07:55:23.970ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90072024-12-21T07:55:23.975ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
90082024-12-21T07:55:23.975ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90092024-12-21T07:55:23.975ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eb422b93-bfdb-4940-8eda-00ad9fd121b1", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
90102024-12-21T07:55:23.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90112024-12-21T07:55:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90122024-12-21T07:55:23.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90132024-12-21T07:55:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90142024-12-21T07:55:23.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90152024-12-21T07:55:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90162024-12-21T07:55:23.983ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90172024-12-21T07:55:23.983ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90182024-12-21T07:55:23.984ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ee33aa2-04cb-4f72-bf99-8248fa5b371b", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
90192024-12-21T07:55:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 402.577195ms iteration = 17 status = {}
90202024-12-21T07:55:24.058ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90212024-12-21T07:55:24.134ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c23d46-6c9f-4b66-9ebd-c1069c602c77", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
90222024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90232024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90242024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90252024-12-21T07:55:24.135ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.469385ms iteration = 17 status = {}
90262024-12-21T07:55:24.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90272024-12-21T07:55:24.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "85f02d19-3d2f-4e1f-8761-83debe90eddd", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90282024-12-21T07:55:24.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90292024-12-21T07:55:24.152ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f0e4f5dd-14cf-4bf1-93e6-a8dec0594bf0", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90302024-12-21T07:55:24.152ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90312024-12-21T07:55:24.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7eebf6e3-5742-4557-b43b-7e7eda94e7bd", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90322024-12-21T07:55:24.154ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90332024-12-21T07:55:24.156ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90342024-12-21T07:55:24.156ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.248012ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90352024-12-21T07:55:24.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90362024-12-21T07:55:24.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90372024-12-21T07:55:24.188ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
90382024-12-21T07:55:24.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90392024-12-21T07:55:24.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90402024-12-21T07:55:24.197ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90412024-12-21T07:55:24.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "49e7f743-332b-4594-a6f4-7b71dd5baa81", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
90422024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90432024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
90442024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90452024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90462024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90472024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90482024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90492024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90502024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90512024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90522024-12-21T07:55:24.198ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
90532024-12-21T07:55:24.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90542024-12-21T07:55:24.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90552024-12-21T07:55:24.201ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90562024-12-21T07:55:24.201ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f7d23c-9e74-49de-aa19-46647c6f7941", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
90572024-12-21T07:55:24.201ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90582024-12-21T07:55:24.201ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb6b6b2e-71ab-4fa1-9851-d9ee50f4a467", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
90592024-12-21T07:55:24.201ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
90602024-12-21T07:55:24.201ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90612024-12-21T07:55:24.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83bdb53c-53d2-4152-b568-b15e044222d0", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
90622024-12-21T07:55:24.316ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
90632024-12-21T07:55:24.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90642024-12-21T07:55:24.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff013c1f-b3d5-4579-aad9-bc7b40fc76cb", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
90652024-12-21T07:55:24.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90662024-12-21T07:55:24.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90672024-12-21T07:55:24.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90682024-12-21T07:55:24.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90692024-12-21T07:55:24.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90702024-12-21T07:55:24.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90712024-12-21T07:55:24.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90722024-12-21T07:55:24.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90732024-12-21T07:55:24.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 750.626774ms iteration = 17 status = {}
90742024-12-21T07:55:24.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b3c05c2-483e-4f53-977b-deb768e63361 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90752024-12-21T07:55:24.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b3c05c2-483e-4f53-977b-deb768e63361 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90762024-12-21T07:55:24.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b3c05c2-483e-4f53-977b-deb768e63361 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90772024-12-21T07:55:25.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 521f4855-b823-4290-8a8d-5a3991c45224 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
90782024-12-21T07:55:25.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76721475-78f0-4919-80b0-91f176c2b08d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90792024-12-21T07:55:25.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76721475-78f0-4919-80b0-91f176c2b08d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90802024-12-21T07:55:25.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76721475-78f0-4919-80b0-91f176c2b08d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90812024-12-21T07:55:26.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10157830-30e2-41ad-a52b-68e13ae68f76 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90822024-12-21T07:55:26.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10157830-30e2-41ad-a52b-68e13ae68f76 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90832024-12-21T07:55:27.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10157830-30e2-41ad-a52b-68e13ae68f76 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90842024-12-21T07:55:28.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 014847ac-6bf5-4b87-89f0-3ea814ca6676 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90852024-12-21T07:55:28.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 014847ac-6bf5-4b87-89f0-3ea814ca6676 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90862024-12-21T07:55:28.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 014847ac-6bf5-4b87-89f0-3ea814ca6676 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90872024-12-21T07:55:29.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05121be0-233c-41b1-aa42-c9e070baa31a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90882024-12-21T07:55:29.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05121be0-233c-41b1-aa42-c9e070baa31a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90892024-12-21T07:55:29.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05121be0-233c-41b1-aa42-c9e070baa31a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90902024-12-21T07:55:30.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0a800b04-c07e-4ef4-ab08-a0646bc4ed0f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90912024-12-21T07:55:30.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0a800b04-c07e-4ef4-ab08-a0646bc4ed0f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90922024-12-21T07:55:30.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0a800b04-c07e-4ef4-ab08-a0646bc4ed0f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90932024-12-21T07:55:31.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19a3dea1-21de-43ed-8f9e-7a1fbf326b6e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90942024-12-21T07:55:31.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19a3dea1-21de-43ed-8f9e-7a1fbf326b6e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90952024-12-21T07:55:31.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19a3dea1-21de-43ed-8f9e-7a1fbf326b6e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90962024-12-21T07:55:32.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a65bceb-e65d-412d-b443-6099e9bc341c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90972024-12-21T07:55:32.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a65bceb-e65d-412d-b443-6099e9bc341c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90982024-12-21T07:55:32.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a65bceb-e65d-412d-b443-6099e9bc341c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
90992024-12-21T07:55:33.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7c79edd-e534-4990-a48a-ef90f8a25326 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91002024-12-21T07:55:33.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7c79edd-e534-4990-a48a-ef90f8a25326 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91012024-12-21T07:55:33.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7c79edd-e534-4990-a48a-ef90f8a25326 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91022024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
91032024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
91042024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91052024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91062024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91072024-12-21T07:55:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91082024-12-21T07:55:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91092024-12-21T07:55:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91102024-12-21T07:55:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91112024-12-21T07:55:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91122024-12-21T07:55:33.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91132024-12-21T07:55:33.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91142024-12-21T07:55:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91152024-12-21T07:55:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
91162024-12-21T07:55:33.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91172024-12-21T07:55:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91182024-12-21T07:55:33.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
91192024-12-21T07:55:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.147626ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
91202024-12-21T07:55:33.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91212024-12-21T07:55:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91222024-12-21T07:55:33.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.932801ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91232024-12-21T07:55:34.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b618b0f9-d78d-44d1-bc0c-3dbb440ebede roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91242024-12-21T07:55:34.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b618b0f9-d78d-44d1-bc0c-3dbb440ebede resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91252024-12-21T07:55:34.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b618b0f9-d78d-44d1-bc0c-3dbb440ebede response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91262024-12-21T07:55:35.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20849b3a-e3c0-460b-8fe2-da0db6655351 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91272024-12-21T07:55:35.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20849b3a-e3c0-460b-8fe2-da0db6655351 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91282024-12-21T07:55:35.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 20849b3a-e3c0-460b-8fe2-da0db6655351 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91292024-12-21T07:55:35.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = ce7a0f9e-84e4-4fe3-b36d-c94cb6531cbd response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
91302024-12-21T07:55:36.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a545627d-26f0-4e1d-a3a8-a1c2c48fa24b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91312024-12-21T07:55:36.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a545627d-26f0-4e1d-a3a8-a1c2c48fa24b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91322024-12-21T07:55:36.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a545627d-26f0-4e1d-a3a8-a1c2c48fa24b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91332024-12-21T07:55:37.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e82e5ca9-0191-477c-a376-7e68cd7621fc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91342024-12-21T07:55:37.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e82e5ca9-0191-477c-a376-7e68cd7621fc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91352024-12-21T07:55:37.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e82e5ca9-0191-477c-a376-7e68cd7621fc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91362024-12-21T07:55:38.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5d9e9802-4f2f-46d2-b804-cf45c33f7ed7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91372024-12-21T07:55:38.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5d9e9802-4f2f-46d2-b804-cf45c33f7ed7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91382024-12-21T07:55:38.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5d9e9802-4f2f-46d2-b804-cf45c33f7ed7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91392024-12-21T07:55:39.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fff4b1-0094-4214-9f2d-964fd96a2b96 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91402024-12-21T07:55:39.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fff4b1-0094-4214-9f2d-964fd96a2b96 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91412024-12-21T07:55:39.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fff4b1-0094-4214-9f2d-964fd96a2b96 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91422024-12-21T07:55:40.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55e88cff-4c58-4b2c-bae0-09bb7b9583a0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91432024-12-21T07:55:40.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55e88cff-4c58-4b2c-bae0-09bb7b9583a0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91442024-12-21T07:55:40.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55e88cff-4c58-4b2c-bae0-09bb7b9583a0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91452024-12-21T07:55:41.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fa28c679-a9b9-4d00-bc15-b61d33eed922 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91462024-12-21T07:55:41.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fa28c679-a9b9-4d00-bc15-b61d33eed922 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91472024-12-21T07:55:41.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fa28c679-a9b9-4d00-bc15-b61d33eed922 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91482024-12-21T07:55:42.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 929a9c23-7f45-4c3e-b54c-d21a91fadb2c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91492024-12-21T07:55:42.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 929a9c23-7f45-4c3e-b54c-d21a91fadb2c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91502024-12-21T07:55:42.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 929a9c23-7f45-4c3e-b54c-d21a91fadb2c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91512024-12-21T07:55:43.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10684596-17b9-472d-b06f-d14095443395 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91522024-12-21T07:55:43.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10684596-17b9-472d-b06f-d14095443395 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91532024-12-21T07:55:43.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10684596-17b9-472d-b06f-d14095443395 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91542024-12-21T07:55:43.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
91552024-12-21T07:55:43.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91562024-12-21T07:55:43.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
91572024-12-21T07:55:43.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91582024-12-21T07:55:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91592024-12-21T07:55:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91602024-12-21T07:55:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91612024-12-21T07:55:43.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91622024-12-21T07:55:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91632024-12-21T07:55:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91642024-12-21T07:55:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91652024-12-21T07:55:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91662024-12-21T07:55:43.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91672024-12-21T07:55:43.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91682024-12-21T07:55:43.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.749925ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91692024-12-21T07:55:43.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702024-12-21T07:55:43.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
91712024-12-21T07:55:43.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91722024-12-21T07:55:43.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91732024-12-21T07:55:43.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
91742024-12-21T07:55:43.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.390364ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
91752024-12-21T07:55:44.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea8e8f28-05ac-43f7-85f1-86a3bf3304f4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91762024-12-21T07:55:44.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea8e8f28-05ac-43f7-85f1-86a3bf3304f4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91772024-12-21T07:55:44.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea8e8f28-05ac-43f7-85f1-86a3bf3304f4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91782024-12-21T07:55:45.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef833687-627c-4be8-9232-4b785d86c697 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91792024-12-21T07:55:45.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef833687-627c-4be8-9232-4b785d86c697 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91802024-12-21T07:55:45.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef833687-627c-4be8-9232-4b785d86c697 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91812024-12-21T07:55:45.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 893 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = e291208f-d4bc-4182-aa54-6876ff8b60c0 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
91822024-12-21T07:55:46.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78255951-615b-4761-aebd-5c0773b0ef5a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91832024-12-21T07:55:46.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78255951-615b-4761-aebd-5c0773b0ef5a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91842024-12-21T07:55:46.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 78255951-615b-4761-aebd-5c0773b0ef5a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91852024-12-21T07:55:47.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = da2bf7e2-cdcb-462f-8bfd-21341a969fee roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91862024-12-21T07:55:47.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = da2bf7e2-cdcb-462f-8bfd-21341a969fee resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91872024-12-21T07:55:47.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = da2bf7e2-cdcb-462f-8bfd-21341a969fee response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91882024-12-21T07:55:48.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56da71cb-4dcd-42b4-9e7c-ea40b6497ffc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91892024-12-21T07:55:48.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56da71cb-4dcd-42b4-9e7c-ea40b6497ffc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91902024-12-21T07:55:48.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 56da71cb-4dcd-42b4-9e7c-ea40b6497ffc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91912024-12-21T07:55:49.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 344861b8-8cd5-49f0-8bc2-606b99fe3fcf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91922024-12-21T07:55:49.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 344861b8-8cd5-49f0-8bc2-606b99fe3fcf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91932024-12-21T07:55:49.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 344861b8-8cd5-49f0-8bc2-606b99fe3fcf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91942024-12-21T07:55:50.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0442b6e7-ba39-4e25-a168-ec32e0e2a6e8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91952024-12-21T07:55:50.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0442b6e7-ba39-4e25-a168-ec32e0e2a6e8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91962024-12-21T07:55:50.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0442b6e7-ba39-4e25-a168-ec32e0e2a6e8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
91972024-12-21T07:55:50.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 96ce8bf8-6543-4f9e-8ec4-7a5c3b1fccf9 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
91982024-12-21T07:55:50.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 96ce8bf8-6543-4f9e-8ec4-7a5c3b1fccf9 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
91992024-12-21T07:55:50.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 96ce8bf8-6543-4f9e-8ec4-7a5c3b1fccf9 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
92002024-12-21T07:55:50.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = dbd43edb-338c-4984-8a4e-6d4fdd95bcfc roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92012024-12-21T07:55:50.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = dbd43edb-338c-4984-8a4e-6d4fdd95bcfc resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92022024-12-21T07:55:50.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = dbd43edb-338c-4984-8a4e-6d4fdd95bcfc response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92032024-12-21T07:55:51.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ad822e8-310a-44d2-a7ca-c29b2dfacd0c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92042024-12-21T07:55:51.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ad822e8-310a-44d2-a7ca-c29b2dfacd0c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92052024-12-21T07:55:51.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9ad822e8-310a-44d2-a7ca-c29b2dfacd0c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92062024-12-21T07:55:52.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9301c28-067b-4367-afef-467fbf9e2522 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92072024-12-21T07:55:52.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9301c28-067b-4367-afef-467fbf9e2522 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92082024-12-21T07:55:52.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d9301c28-067b-4367-afef-467fbf9e2522 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92092024-12-21T07:55:53.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c3fcb2f-4af2-4c95-8c12-9f6bdea92c72 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92102024-12-21T07:55:53.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c3fcb2f-4af2-4c95-8c12-9f6bdea92c72 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92112024-12-21T07:55:53.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2c3fcb2f-4af2-4c95-8c12-9f6bdea92c72 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
92122024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
92132024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
92142024-12-21T07:55:53.582ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92152024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92162024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92172024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92182024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92192024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92202024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92212024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
92222024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92232024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
92242024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
92252024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92262024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92272024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
92282024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
92292024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92302024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
92312024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92322024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
92332024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92342024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92352024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92362024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92372024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92382024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92392024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
92402024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92412024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
92422024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92432024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
92442024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92452024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
92462024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92472024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92482024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92492024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92502024-12-21T07:55:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92512024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92522024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92532024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92542024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92552024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92562024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92572024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92582024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92592024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92602024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92612024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92622024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92632024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92642024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92652024-12-21T07:55:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.857526ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92662024-12-21T07:55:53.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 534974209 } })
92672024-12-21T07:55:53.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92682024-12-21T07:55:53.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 535487708 } })
92692024-12-21T07:55:53.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92702024-12-21T07:55:53.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92712024-12-21T07:55:53.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92722024-12-21T07:55:53.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92732024-12-21T07:55:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92742024-12-21T07:55:53.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92752024-12-21T07:55:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92762024-12-21T07:55:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92772024-12-21T07:55:53.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92782024-12-21T07:55:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92792024-12-21T07:55:53.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92802024-12-21T07:55:53.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92812024-12-21T07:55:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92822024-12-21T07:55:53.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92832024-12-21T07:55:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92842024-12-21T07:55:53.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92852024-12-21T07:55:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92862024-12-21T07:55:53.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92872024-12-21T07:55:53.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.959494ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92882024-12-21T07:55:53.605ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92892024-12-21T07:55:53.605ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92902024-12-21T07:55:53.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92912024-12-21T07:55:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92922024-12-21T07:55:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92932024-12-21T07:55:53.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92942024-12-21T07:55:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92952024-12-21T07:55:53.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92962024-12-21T07:55:53.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92972024-12-21T07:55:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92982024-12-21T07:55:53.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92992024-12-21T07:55:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93002024-12-21T07:55:53.612ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93012024-12-21T07:55:53.612ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93022024-12-21T07:55:53.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93032024-12-21T07:55:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93042024-12-21T07:55:53.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 561563185 } })
93052024-12-21T07:55:53.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
93062024-12-21T07:55:53.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93072024-12-21T07:55:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93082024-12-21T07:55:53.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93092024-12-21T07:55:53.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93102024-12-21T07:55:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93112024-12-21T07:55:53.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93122024-12-21T07:55:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93132024-12-21T07:55:53.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.405116ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
93142024-12-21T07:55:53.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93152024-12-21T07:55:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93162024-12-21T07:55:53.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93172024-12-21T07:55:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93182024-12-21T07:55:53.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93192024-12-21T07:55:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93202024-12-21T07:55:53.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.083559ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
93212024-12-21T07:55:53.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93222024-12-21T07:55:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93232024-12-21T07:55:53.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93242024-12-21T07:55:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93252024-12-21T07:55:53.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93262024-12-21T07:55:53.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93272024-12-21T07:55:53.664ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93282024-12-21T07:55:53.665ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b6991a2-c682-46c4-bd33-d9812ff56616", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93292024-12-21T07:55:53.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93302024-12-21T07:55:53.666ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93312024-12-21T07:55:53.666ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93322024-12-21T07:55:53.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.263616ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93332024-12-21T07:55:53.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93342024-12-21T07:55:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
93352024-12-21T07:55:53.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93362024-12-21T07:55:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93372024-12-21T07:55:53.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93382024-12-21T07:55:53.668ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93392024-12-21T07:55:53.668ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fafeab31-e0d9-4f46-8e68-378ad82d11d2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93402024-12-21T07:55:53.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93412024-12-21T07:55:53.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422024-12-21T07:55:53.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93432024-12-21T07:55:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93442024-12-21T07:55:53.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93452024-12-21T07:55:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93462024-12-21T07:55:53.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
93472024-12-21T07:55:53.705ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93482024-12-21T07:55:53.705ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0052d4-cb5d-41b7-96aa-daba57a780c1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93492024-12-21T07:55:53.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93502024-12-21T07:55:53.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
93512024-12-21T07:55:53.708ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93522024-12-21T07:55:53.708ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93532024-12-21T07:55:53.708ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "561cb47c-6acf-4825-8805-3253592804e3", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93542024-12-21T07:55:53.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93552024-12-21T07:55:53.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93562024-12-21T07:55:53.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93572024-12-21T07:55:53.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93582024-12-21T07:55:53.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93592024-12-21T07:55:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
93602024-12-21T07:55:53.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93612024-12-21T07:55:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93622024-12-21T07:55:53.724ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 140.129013ms iteration = 18 status = 0
93632024-12-21T07:55:53.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
93642024-12-21T07:55:53.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.790836ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
93652024-12-21T07:55:53.735ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93662024-12-21T07:55:53.735ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93672024-12-21T07:55:53.736ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4ed4b447-b740-4ec5-bff5-680f02ff30af", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93682024-12-21T07:55:53.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93692024-12-21T07:55:53.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93702024-12-21T07:55:53.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93712024-12-21T07:55:53.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93722024-12-21T07:55:53.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93732024-12-21T07:55:53.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93742024-12-21T07:55:53.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93752024-12-21T07:55:53.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93762024-12-21T07:55:53.747ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93772024-12-21T07:55:53.747ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93782024-12-21T07:55:53.747ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "48e4507c-e605-432b-acd2-a8e8811257f4", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93792024-12-21T07:55:53.749ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 166.839342ms iteration = 18 status = {}
93802024-12-21T07:55:53.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 168.634023ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93812024-12-21T07:55:53.754ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93822024-12-21T07:55:53.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93832024-12-21T07:55:53.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93842024-12-21T07:55:53.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec174d1f-800b-4701-838e-0a81e19344a5", "content-length": "1", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
93852024-12-21T07:55:53.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.688536ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93862024-12-21T07:55:53.757ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 174.952841ms iteration = 18 status = {}
93872024-12-21T07:55:53.758ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93882024-12-21T07:55:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93892024-12-21T07:55:53.759ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 177.526235ms iteration = 18 status = null
93902024-12-21T07:55:53.766ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93912024-12-21T07:55:53.766ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 183.65109ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93922024-12-21T07:55:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 202.86783ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93932024-12-21T07:55:53.832ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.213531ms iteration = 20 status = {"physical_disks_added":0}
93942024-12-21T07:55:53.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93952024-12-21T07:55:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93962024-12-21T07:55:53.841ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
93972024-12-21T07:55:53.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93982024-12-21T07:55:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93992024-12-21T07:55:53.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94002024-12-21T07:55:53.850ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1058def-43ea-4bb8-962f-8b35a0b7aaee", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94012024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94022024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
94032024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94042024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94052024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94062024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94072024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94082024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94092024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94102024-12-21T07:55:53.850ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94112024-12-21T07:55:53.851ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
94122024-12-21T07:55:53.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94132024-12-21T07:55:53.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94142024-12-21T07:55:53.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94152024-12-21T07:55:53.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dba685c3-99f6-499b-972b-2b98d2c32225", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94162024-12-21T07:55:53.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94172024-12-21T07:55:53.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e301c603-5286-45b5-819b-6499d3c8829c", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94182024-12-21T07:55:53.853ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
94192024-12-21T07:55:53.853ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94202024-12-21T07:55:53.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94212024-12-21T07:55:53.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94222024-12-21T07:55:53.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94232024-12-21T07:55:53.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94242024-12-21T07:55:53.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94252024-12-21T07:55:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94262024-12-21T07:55:53.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94272024-12-21T07:55:53.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94282024-12-21T07:55:53.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94292024-12-21T07:55:53.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94302024-12-21T07:55:53.959ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94312024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "69bbbb5f-95ec-47cd-abc2-f264a37a6d19", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94322024-12-21T07:55:53.960ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
94332024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94342024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b27d9815-a3f0-490e-98ac-609bbee76cc8", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94352024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94362024-12-21T07:55:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94372024-12-21T07:55:53.961ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee145bb5-7b4e-401d-b500-c30f77a4acd0", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
94382024-12-21T07:55:53.961ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94392024-12-21T07:55:53.961ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94402024-12-21T07:55:53.961ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94412024-12-21T07:55:53.962ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 380.497576ms iteration = 18 status = {}
94422024-12-21T07:55:53.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94432024-12-21T07:55:53.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94442024-12-21T07:55:53.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94452024-12-21T07:55:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94462024-12-21T07:55:53.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94472024-12-21T07:55:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94482024-12-21T07:55:53.977ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 394.885083ms iteration = 18 status = {}
94492024-12-21T07:55:54.257ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94502024-12-21T07:55:54.257ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94512024-12-21T07:55:54.287ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94522024-12-21T07:55:54.287ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42331
94532024-12-21T07:55:54.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42331 req_id = e09878c6-d03a-498c-b66a-6fbb59ed6d91 roles = RoleSet { roles: {} } uri = /metrics/producers
94542024-12-21T07:55:54.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42331 req_id = e09878c6-d03a-498c-b66a-6fbb59ed6d91 resource = Database result = Ok(()) uri = /metrics/producers
94552024-12-21T07:55:54.326ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
94562024-12-21T07:55:54.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38195 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42331 req_id = e09878c6-d03a-498c-b66a-6fbb59ed6d91 response_code = 201 uri = /metrics/producers
94572024-12-21T07:55:54.326ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e09878c6-d03a-498c-b66a-6fbb59ed6d91", "content-length": "41", "date": "Sat, 21 Dec 2024 07:55:54 GMT"} })
94582024-12-21T07:55:54.327ZDEBGnexus (producer-registration-task): registered with nexus successfully
94592024-12-21T07:55:54.327ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94602024-12-21T07:55:54.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5edf31b1-3768-48af-b630-b80b859b23e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94612024-12-21T07:55:54.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5edf31b1-3768-48af-b630-b80b859b23e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94622024-12-21T07:55:54.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5edf31b1-3768-48af-b630-b80b859b23e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94632024-12-21T07:55:55.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05bfcb7e-cabc-4016-976c-b288291c8c29 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94642024-12-21T07:55:55.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05bfcb7e-cabc-4016-976c-b288291c8c29 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94652024-12-21T07:55:55.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 05bfcb7e-cabc-4016-976c-b288291c8c29 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94662024-12-21T07:55:55.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 3caeb582-ba5a-4af1-9263-74aa598a6f67 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
94672024-12-21T07:55:56.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 088a7945-0a8e-4209-8fc8-f8d066b08867 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94682024-12-21T07:55:56.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 088a7945-0a8e-4209-8fc8-f8d066b08867 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94692024-12-21T07:55:56.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 088a7945-0a8e-4209-8fc8-f8d066b08867 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94702024-12-21T07:55:57.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3027674-20c5-42e1-8599-1d86db921f97 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94712024-12-21T07:55:57.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3027674-20c5-42e1-8599-1d86db921f97 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94722024-12-21T07:55:57.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3027674-20c5-42e1-8599-1d86db921f97 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94732024-12-21T07:55:58.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdc820a3-9021-4cbf-bd8f-be36a78dca5a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94742024-12-21T07:55:58.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdc820a3-9021-4cbf-bd8f-be36a78dca5a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94752024-12-21T07:55:58.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdc820a3-9021-4cbf-bd8f-be36a78dca5a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94762024-12-21T07:55:59.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbd8bc21-ba31-4076-80bc-02cf3c39438d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94772024-12-21T07:55:59.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbd8bc21-ba31-4076-80bc-02cf3c39438d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94782024-12-21T07:55:59.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbd8bc21-ba31-4076-80bc-02cf3c39438d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94792024-12-21T07:56:00.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d4cab0b-fabf-4a71-a3d8-ad4f8ad8425b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94802024-12-21T07:56:00.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d4cab0b-fabf-4a71-a3d8-ad4f8ad8425b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94812024-12-21T07:56:00.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0d4cab0b-fabf-4a71-a3d8-ad4f8ad8425b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94822024-12-21T07:56:01.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 461ff928-616a-488a-8e23-adec8f0a8a32 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94832024-12-21T07:56:01.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 461ff928-616a-488a-8e23-adec8f0a8a32 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94842024-12-21T07:56:01.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 461ff928-616a-488a-8e23-adec8f0a8a32 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94852024-12-21T07:56:02.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37980c35-5299-4e35-924c-1d26e7abde90 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94862024-12-21T07:56:02.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37980c35-5299-4e35-924c-1d26e7abde90 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94872024-12-21T07:56:02.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 37980c35-5299-4e35-924c-1d26e7abde90 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
94882024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
94892024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
94902024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94912024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94922024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94932024-12-21T07:56:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94942024-12-21T07:56:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94952024-12-21T07:56:03.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94962024-12-21T07:56:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94972024-12-21T07:56:03.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.191692ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94982024-12-21T07:56:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94992024-12-21T07:56:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95002024-12-21T07:56:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95012024-12-21T07:56:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95022024-12-21T07:56:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95032024-12-21T07:56:03.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95042024-12-21T07:56:03.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
95052024-12-21T07:56:03.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95062024-12-21T07:56:03.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95072024-12-21T07:56:03.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
95082024-12-21T07:56:03.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.050928ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
95092024-12-21T07:56:03.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdac6dcf-fbe0-4018-88c2-9b260b983fa6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95102024-12-21T07:56:03.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdac6dcf-fbe0-4018-88c2-9b260b983fa6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95112024-12-21T07:56:03.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cdac6dcf-fbe0-4018-88c2-9b260b983fa6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95122024-12-21T07:56:04.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48b1f3d5-2bba-48bb-bfa5-4c6ceeedf8f7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95132024-12-21T07:56:04.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48b1f3d5-2bba-48bb-bfa5-4c6ceeedf8f7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95142024-12-21T07:56:04.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48b1f3d5-2bba-48bb-bfa5-4c6ceeedf8f7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95152024-12-21T07:56:05.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef135838-18dc-4ae7-852b-b3000a560dd8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95162024-12-21T07:56:05.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef135838-18dc-4ae7-852b-b3000a560dd8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95172024-12-21T07:56:05.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ef135838-18dc-4ae7-852b-b3000a560dd8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95182024-12-21T07:56:05.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 7302238f-f739-4758-a6a7-79d9ad47dd6b response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
95192024-12-21T07:56:06.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8f34d881-fed9-4822-8872-aade960591e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95202024-12-21T07:56:06.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8f34d881-fed9-4822-8872-aade960591e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95212024-12-21T07:56:06.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8f34d881-fed9-4822-8872-aade960591e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95222024-12-21T07:56:07.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 65b97e54-f5af-491b-8cc0-c57d723ed382 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95232024-12-21T07:56:07.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 65b97e54-f5af-491b-8cc0-c57d723ed382 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95242024-12-21T07:56:07.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 65b97e54-f5af-491b-8cc0-c57d723ed382 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95252024-12-21T07:56:08.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93c171b4-37bc-4004-8153-9aa1c3b3c146 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95262024-12-21T07:56:08.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93c171b4-37bc-4004-8153-9aa1c3b3c146 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95272024-12-21T07:56:08.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 93c171b4-37bc-4004-8153-9aa1c3b3c146 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95282024-12-21T07:56:09.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b7a1c00-831c-48c5-9793-060e727ee50a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95292024-12-21T07:56:09.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b7a1c00-831c-48c5-9793-060e727ee50a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95302024-12-21T07:56:09.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b7a1c00-831c-48c5-9793-060e727ee50a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95312024-12-21T07:56:10.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe0e65e1-32ce-4e9c-8653-0862ec71340c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95322024-12-21T07:56:10.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe0e65e1-32ce-4e9c-8653-0862ec71340c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95332024-12-21T07:56:10.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe0e65e1-32ce-4e9c-8653-0862ec71340c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95342024-12-21T07:56:11.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f890a92-29da-443f-8852-239ce730f722 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95352024-12-21T07:56:11.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f890a92-29da-443f-8852-239ce730f722 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95362024-12-21T07:56:11.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9f890a92-29da-443f-8852-239ce730f722 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95372024-12-21T07:56:13.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2b6b0360-290c-46dd-9c0f-dcd636d38bce roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95382024-12-21T07:56:13.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2b6b0360-290c-46dd-9c0f-dcd636d38bce resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95392024-12-21T07:56:13.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2b6b0360-290c-46dd-9c0f-dcd636d38bce response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95402024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
95412024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95422024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
95432024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95442024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95452024-12-21T07:56:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95462024-12-21T07:56:13.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95472024-12-21T07:56:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95482024-12-21T07:56:13.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.345427ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95492024-12-21T07:56:13.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95502024-12-21T07:56:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95512024-12-21T07:56:13.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95522024-12-21T07:56:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95532024-12-21T07:56:13.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95542024-12-21T07:56:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95552024-12-21T07:56:13.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95562024-12-21T07:56:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
95572024-12-21T07:56:13.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95582024-12-21T07:56:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95592024-12-21T07:56:13.639ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
95602024-12-21T07:56:13.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.412818ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
95612024-12-21T07:56:14.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9172f677-e8ba-45c5-9544-d5b296bfbab4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95622024-12-21T07:56:14.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9172f677-e8ba-45c5-9544-d5b296bfbab4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95632024-12-21T07:56:14.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9172f677-e8ba-45c5-9544-d5b296bfbab4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95642024-12-21T07:56:15.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81cb20f9-1839-4087-8bf8-b97e38b24cbe roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95652024-12-21T07:56:15.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81cb20f9-1839-4087-8bf8-b97e38b24cbe resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95662024-12-21T07:56:15.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81cb20f9-1839-4087-8bf8-b97e38b24cbe response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95672024-12-21T07:56:15.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = d149543c-e810-4c46-ad99-d8d5c3e19795 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
95682024-12-21T07:56:16.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7393761-7253-4393-bf13-16e02f245653 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95692024-12-21T07:56:16.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7393761-7253-4393-bf13-16e02f245653 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95702024-12-21T07:56:16.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f7393761-7253-4393-bf13-16e02f245653 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95712024-12-21T07:56:17.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d162e8ef-0b8e-49f7-9726-fb30d7ce3686 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95722024-12-21T07:56:17.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d162e8ef-0b8e-49f7-9726-fb30d7ce3686 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95732024-12-21T07:56:17.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d162e8ef-0b8e-49f7-9726-fb30d7ce3686 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95742024-12-21T07:56:18.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff075243-5d12-494d-8926-85bbe5c2450e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95752024-12-21T07:56:18.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff075243-5d12-494d-8926-85bbe5c2450e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95762024-12-21T07:56:18.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff075243-5d12-494d-8926-85bbe5c2450e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95772024-12-21T07:56:19.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c89184f-c4b4-4e83-80d3-8780a1706f44 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95782024-12-21T07:56:19.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c89184f-c4b4-4e83-80d3-8780a1706f44 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95792024-12-21T07:56:19.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6c89184f-c4b4-4e83-80d3-8780a1706f44 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95802024-12-21T07:56:20.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420d0e59-227c-4c5e-8bfe-8ae739f221f2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95812024-12-21T07:56:20.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420d0e59-227c-4c5e-8bfe-8ae739f221f2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95822024-12-21T07:56:20.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420d0e59-227c-4c5e-8bfe-8ae739f221f2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95832024-12-21T07:56:20.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 27f3935f-cc8e-4c7d-83ff-a85cd889e2e0 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
95842024-12-21T07:56:20.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 27f3935f-cc8e-4c7d-83ff-a85cd889e2e0 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
95852024-12-21T07:56:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 27f3935f-cc8e-4c7d-83ff-a85cd889e2e0 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
95862024-12-21T07:56:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d9431f35-74bf-4eaf-8fd6-fe5126d37bd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
95872024-12-21T07:56:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d9431f35-74bf-4eaf-8fd6-fe5126d37bd5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
95882024-12-21T07:56:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = d9431f35-74bf-4eaf-8fd6-fe5126d37bd5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
95892024-12-21T07:56:21.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02c54577-0b03-42c9-870c-3e5cd36abfd0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95902024-12-21T07:56:21.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02c54577-0b03-42c9-870c-3e5cd36abfd0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95912024-12-21T07:56:21.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02c54577-0b03-42c9-870c-3e5cd36abfd0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95922024-12-21T07:56:22.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3252125-aa14-4059-ba5f-6ec1c9c510f5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95932024-12-21T07:56:22.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3252125-aa14-4059-ba5f-6ec1c9c510f5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95942024-12-21T07:56:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d3252125-aa14-4059-ba5f-6ec1c9c510f5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95952024-12-21T07:56:23.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b92f0359-26c4-49e5-8d63-ed5d47598f0d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95962024-12-21T07:56:23.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b92f0359-26c4-49e5-8d63-ed5d47598f0d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95972024-12-21T07:56:23.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b92f0359-26c4-49e5-8d63-ed5d47598f0d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
95982024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
95992024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96002024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96012024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96022024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
96032024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96042024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
96052024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96062024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96072024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96082024-12-21T07:56:23.583ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96092024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96102024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
96112024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96122024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96132024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96142024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96152024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96162024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
96172024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96182024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
96192024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96202024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
96212024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96222024-12-21T07:56:23.583ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
96232024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
96242024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.49\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
96252024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
96262024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96272024-12-21T07:56:23.583ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:46:23.583517745 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96282024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96292024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
96302024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96312024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
96322024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96332024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96342024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96352024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96362024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
96372024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96382024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96392024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96402024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96412024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96422024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
96432024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96442024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96452024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96462024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96472024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96482024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96492024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96502024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96512024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
96522024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96532024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
96542024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96552024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96562024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96572024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96582024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96592024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96602024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96612024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96622024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96632024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96642024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96652024-12-21T07:56:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96662024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96672024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96682024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96692024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96702024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96712024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96722024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96732024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96742024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96752024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96762024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96772024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96782024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96792024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96802024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96812024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96822024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96832024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96842024-12-21T07:56:23.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 532203302 } })
96852024-12-21T07:56:23.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 532242652 } })
96862024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96872024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96882024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96892024-12-21T07:56:23.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96902024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96912024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96922024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
96932024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.603808ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
96942024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96952024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.74205ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96962024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96972024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
96982024-12-21T07:56:23.585ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96992024-12-21T07:56:23.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97002024-12-21T07:56:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97012024-12-21T07:56:23.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97022024-12-21T07:56:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97032024-12-21T07:56:23.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97042024-12-21T07:56:23.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97052024-12-21T07:56:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.174862ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97062024-12-21T07:56:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97072024-12-21T07:56:23.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 542779573 } })
97082024-12-21T07:56:23.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97092024-12-21T07:56:23.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97102024-12-21T07:56:23.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97112024-12-21T07:56:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97122024-12-21T07:56:23.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 547149058 } })
97132024-12-21T07:56:23.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97142024-12-21T07:56:23.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:46:23.583517745 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97152024-12-21T07:56:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.200985ms iteration = 10 status = {"expiration":"2024-12-21T07:46:23.583517745Z","pruned":[]}
97162024-12-21T07:56:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97172024-12-21T07:56:23.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97182024-12-21T07:56:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97192024-12-21T07:56:23.602ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.152228ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97202024-12-21T07:56:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97212024-12-21T07:56:23.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97222024-12-21T07:56:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97232024-12-21T07:56:23.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97242024-12-21T07:56:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97252024-12-21T07:56:23.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97262024-12-21T07:56:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97272024-12-21T07:56:23.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97282024-12-21T07:56:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97292024-12-21T07:56:23.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97302024-12-21T07:56:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97312024-12-21T07:56:23.630ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97322024-12-21T07:56:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97332024-12-21T07:56:23.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97342024-12-21T07:56:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97352024-12-21T07:56:23.654ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97362024-12-21T07:56:23.654ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97372024-12-21T07:56:23.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97382024-12-21T07:56:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97392024-12-21T07:56:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.143246ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97402024-12-21T07:56:23.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97412024-12-21T07:56:23.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97422024-12-21T07:56:23.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97432024-12-21T07:56:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.974638ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97442024-12-21T07:56:23.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97452024-12-21T07:56:23.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97462024-12-21T07:56:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97472024-12-21T07:56:23.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482024-12-21T07:56:23.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97492024-12-21T07:56:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97502024-12-21T07:56:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97512024-12-21T07:56:23.676ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97522024-12-21T07:56:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97532024-12-21T07:56:23.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97542024-12-21T07:56:23.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97552024-12-21T07:56:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97562024-12-21T07:56:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97572024-12-21T07:56:23.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97582024-12-21T07:56:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97592024-12-21T07:56:23.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97602024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97612024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97622024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 103.484445ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
97632024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97642024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97652024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97662024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97672024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97682024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97692024-12-21T07:56:23.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97702024-12-21T07:56:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97712024-12-21T07:56:23.688ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722024-12-21T07:56:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97732024-12-21T07:56:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97742024-12-21T07:56:23.691ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97752024-12-21T07:56:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97762024-12-21T07:56:23.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97772024-12-21T07:56:23.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97782024-12-21T07:56:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97792024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97802024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97812024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97822024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97832024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97842024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97852024-12-21T07:56:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97862024-12-21T07:56:23.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97872024-12-21T07:56:23.698ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-12-21T07:56:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97892024-12-21T07:56:23.701ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 648906603 } })
97902024-12-21T07:56:23.701ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
97912024-12-21T07:56:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97922024-12-21T07:56:23.701ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97932024-12-21T07:56:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97942024-12-21T07:56:23.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.645537ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97952024-12-21T07:56:23.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97962024-12-21T07:56:23.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97972024-12-21T07:56:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97982024-12-21T07:56:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97992024-12-21T07:56:23.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98002024-12-21T07:56:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98012024-12-21T07:56:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 130.57131ms iteration = 5 status = {"nsuccess":5}
98022024-12-21T07:56:23.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032024-12-21T07:56:23.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98042024-12-21T07:56:23.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98052024-12-21T07:56:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98062024-12-21T07:56:23.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98072024-12-21T07:56:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98082024-12-21T07:56:23.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98092024-12-21T07:56:23.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98102024-12-21T07:56:23.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98112024-12-21T07:56:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98122024-12-21T07:56:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98132024-12-21T07:56:23.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98142024-12-21T07:56:23.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98152024-12-21T07:56:23.725ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98162024-12-21T07:56:23.725ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98172024-12-21T07:56:23.725ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98182024-12-21T07:56:23.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98192024-12-21T07:56:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98202024-12-21T07:56:23.743ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98212024-12-21T07:56:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 160.083106ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98222024-12-21T07:56:23.744ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98232024-12-21T07:56:23.744ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98242024-12-21T07:56:23.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98252024-12-21T07:56:23.744ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98262024-12-21T07:56:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98272024-12-21T07:56:23.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.349078ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98282024-12-21T07:56:23.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98292024-12-21T07:56:23.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98302024-12-21T07:56:23.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98312024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
98322024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98332024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98342024-12-21T07:56:23.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98352024-12-21T07:56:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98362024-12-21T07:56:23.758ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98372024-12-21T07:56:23.758ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98382024-12-21T07:56:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 172.394847ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98392024-12-21T07:56:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 175.067932ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98402024-12-21T07:56:23.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-12-21T07:56:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 178.032214ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98422024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98432024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98442024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98452024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98462024-12-21T07:56:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98472024-12-21T07:56:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
98482024-12-21T07:56:23.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98492024-12-21T07:56:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98502024-12-21T07:56:23.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98512024-12-21T07:56:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 181.9534ms iteration = 19 status = 0
98522024-12-21T07:56:23.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98532024-12-21T07:56:23.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98542024-12-21T07:56:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98552024-12-21T07:56:23.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98562024-12-21T07:56:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98572024-12-21T07:56:23.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98582024-12-21T07:56:23.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98592024-12-21T07:56:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98602024-12-21T07:56:23.770ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
98612024-12-21T07:56:23.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 186.982717ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
98622024-12-21T07:56:23.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98632024-12-21T07:56:23.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98642024-12-21T07:56:23.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
98652024-12-21T07:56:23.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98662024-12-21T07:56:23.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98672024-12-21T07:56:23.773ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98682024-12-21T07:56:23.773ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98692024-12-21T07:56:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98702024-12-21T07:56:23.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98712024-12-21T07:56:23.773ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c1278d4-cbb5-4f39-920f-49bb99b45d26", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
98722024-12-21T07:56:23.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98732024-12-21T07:56:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98742024-12-21T07:56:23.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98752024-12-21T07:56:23.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98762024-12-21T07:56:23.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98772024-12-21T07:56:23.775ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98782024-12-21T07:56:23.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98792024-12-21T07:56:23.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98802024-12-21T07:56:23.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98812024-12-21T07:56:23.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98822024-12-21T07:56:23.781ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
98832024-12-21T07:56:23.781ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98842024-12-21T07:56:23.781ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
98852024-12-21T07:56:23.781ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 198.495585ms iteration = 10 status = {"generation":2}
98862024-12-21T07:56:23.784ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98872024-12-21T07:56:23.784ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98882024-12-21T07:56:23.784ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4edef7b-d363-43cd-96a6-26bc52ce033e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
98892024-12-21T07:56:23.784ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98902024-12-21T07:56:23.785ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98912024-12-21T07:56:23.785ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98922024-12-21T07:56:23.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 202.613925ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98932024-12-21T07:56:23.786ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98942024-12-21T07:56:23.833ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98952024-12-21T07:56:23.833ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98962024-12-21T07:56:23.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98972024-12-21T07:56:23.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98982024-12-21T07:56:23.835ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
98992024-12-21T07:56:23.835ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 252.464199ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99002024-12-21T07:56:23.858ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99012024-12-21T07:56:23.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 274.63598ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99022024-12-21T07:56:23.865ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 281.964596ms iteration = 21 status = {"physical_disks_added":0}
99032024-12-21T07:56:23.911ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99042024-12-21T07:56:23.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "618c0263-2108-44d9-bbef-c1874963f7d2", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99052024-12-21T07:56:23.911ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99062024-12-21T07:56:23.914ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "410a435b-e756-4a5e-9d67-374e7dd3f8ec", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99072024-12-21T07:56:23.914ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99082024-12-21T07:56:23.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99092024-12-21T07:56:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 333.779324ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99102024-12-21T07:56:23.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99112024-12-21T07:56:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99122024-12-21T07:56:23.956ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99132024-12-21T07:56:23.957ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab2451a4-a450-455f-a6e3-8b8ccd7f3a3f", "content-length": "1", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99142024-12-21T07:56:23.958ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99152024-12-21T07:56:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99162024-12-21T07:56:23.963ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 380.191001ms iteration = 19 status = {}
99172024-12-21T07:56:23.978ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99182024-12-21T07:56:23.978ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99192024-12-21T07:56:23.978ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "11c058b6-820e-4a06-9b8f-c422833af730", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99202024-12-21T07:56:23.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99212024-12-21T07:56:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99222024-12-21T07:56:23.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99232024-12-21T07:56:23.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99242024-12-21T07:56:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 398.363692ms iteration = 19 status = null
99252024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99262024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99272024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99282024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99292024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99302024-12-21T07:56:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99312024-12-21T07:56:23.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99322024-12-21T07:56:23.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
99332024-12-21T07:56:23.985ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99342024-12-21T07:56:23.985ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50c9685e-7114-492b-9e0f-7ec9bdb28c81", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99352024-12-21T07:56:23.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99362024-12-21T07:56:23.987ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99372024-12-21T07:56:23.987ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99382024-12-21T07:56:23.987ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
99392024-12-21T07:56:23.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 403.375478ms iteration = 10 status = {"generation":1}
99402024-12-21T07:56:23.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99412024-12-21T07:56:23.988ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
99422024-12-21T07:56:23.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99432024-12-21T07:56:23.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99442024-12-21T07:56:23.994ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99452024-12-21T07:56:24.030ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99462024-12-21T07:56:24.030ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99472024-12-21T07:56:24.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99482024-12-21T07:56:24.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "229ad06f-f3e6-402e-a39f-40df7fe3a691", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99492024-12-21T07:56:24.063ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99502024-12-21T07:56:24.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "abbaa0da-b751-4a19-8a52-f5f869be432b", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99512024-12-21T07:56:24.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99522024-12-21T07:56:24.065ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "21e6c71d-db78-4c0b-86c6-5fbce756ab5c", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99532024-12-21T07:56:24.065ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99542024-12-21T07:56:24.067ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99552024-12-21T07:56:24.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.49936ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99562024-12-21T07:56:24.109ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "58ef8fd0-c6e0-41a7-88ea-f3099bc4cf09", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99572024-12-21T07:56:24.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99582024-12-21T07:56:24.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99592024-12-21T07:56:24.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99602024-12-21T07:56:24.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99612024-12-21T07:56:24.115ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99622024-12-21T07:56:24.115ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f713a4ff-59fe-40d5-a9e7-4e87d0461f1a", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99632024-12-21T07:56:24.115ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99642024-12-21T07:56:24.115ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99652024-12-21T07:56:24.115ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99662024-12-21T07:56:24.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99672024-12-21T07:56:24.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99682024-12-21T07:56:24.117ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.230403ms iteration = 19 status = {}
99692024-12-21T07:56:24.119ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99702024-12-21T07:56:24.119ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99712024-12-21T07:56:24.120ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca201d51-0b4d-4309-9297-10b35f1aefb4", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99722024-12-21T07:56:24.122ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 538.768021ms iteration = 19 status = {}
99732024-12-21T07:56:24.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99742024-12-21T07:56:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99752024-12-21T07:56:24.150ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
99762024-12-21T07:56:24.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99772024-12-21T07:56:24.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99782024-12-21T07:56:24.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99792024-12-21T07:56:24.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "888bee1f-83f4-4bd4-ba95-6bab80956bac", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99802024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99812024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
99822024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99832024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99842024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99852024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99862024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99872024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99882024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99892024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99902024-12-21T07:56:24.159ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
99912024-12-21T07:56:24.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99922024-12-21T07:56:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99932024-12-21T07:56:24.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99942024-12-21T07:56:24.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9554d477-a673-4433-afb6-c83a8286b7b3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99952024-12-21T07:56:24.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99962024-12-21T07:56:24.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a02fcac7-ec7b-4de8-8a47-89ca86e3afca", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
99972024-12-21T07:56:24.162ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
99982024-12-21T07:56:24.162ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99992024-12-21T07:56:24.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a1fbc9f5-bfb7-4ad7-8b86-8d372b42c583 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100002024-12-21T07:56:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a1fbc9f5-bfb7-4ad7-8b86-8d372b42c583 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100012024-12-21T07:56:24.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a1fbc9f5-bfb7-4ad7-8b86-8d372b42c583 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100022024-12-21T07:56:24.345ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "59df908f-cfbd-4ecb-b13f-b95d662eb7f5", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
100032024-12-21T07:56:24.345ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
100042024-12-21T07:56:24.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100052024-12-21T07:56:24.345ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5ecd490-a9ef-4cd9-8cb5-13657e85b3b5", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
100062024-12-21T07:56:24.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100072024-12-21T07:56:24.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100082024-12-21T07:56:24.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100092024-12-21T07:56:24.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100102024-12-21T07:56:24.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100112024-12-21T07:56:24.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100122024-12-21T07:56:24.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100132024-12-21T07:56:24.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100142024-12-21T07:56:24.364ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 780.320944ms iteration = 19 status = {}
100152024-12-21T07:56:25.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4ffb125-f9a1-4157-886e-573f6c6d9ab6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100162024-12-21T07:56:25.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4ffb125-f9a1-4157-886e-573f6c6d9ab6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100172024-12-21T07:56:25.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d4ffb125-f9a1-4157-886e-573f6c6d9ab6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100182024-12-21T07:56:25.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 22e0dda2-4cba-44e9-b5e6-4d3d7a745c1a response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
100192024-12-21T07:56:26.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b79a8e-cf0e-4780-860b-715ae07a9c91 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100202024-12-21T07:56:26.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b79a8e-cf0e-4780-860b-715ae07a9c91 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100212024-12-21T07:56:26.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 38b79a8e-cf0e-4780-860b-715ae07a9c91 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100222024-12-21T07:56:27.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8defa176-015b-4a3b-8d06-1d3c580e1ecc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100232024-12-21T07:56:27.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8defa176-015b-4a3b-8d06-1d3c580e1ecc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100242024-12-21T07:56:27.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8defa176-015b-4a3b-8d06-1d3c580e1ecc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100252024-12-21T07:56:28.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e99ba720-fafa-4990-9e11-53ca68b9ee45 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100262024-12-21T07:56:28.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e99ba720-fafa-4990-9e11-53ca68b9ee45 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100272024-12-21T07:56:28.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e99ba720-fafa-4990-9e11-53ca68b9ee45 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100282024-12-21T07:56:29.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7210f4c3-5a69-4ad3-b419-c794acfd7655 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100292024-12-21T07:56:29.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7210f4c3-5a69-4ad3-b419-c794acfd7655 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100302024-12-21T07:56:29.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7210f4c3-5a69-4ad3-b419-c794acfd7655 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100312024-12-21T07:56:30.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad6522c-866b-4eb8-85f8-f1ed5703023d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100322024-12-21T07:56:30.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad6522c-866b-4eb8-85f8-f1ed5703023d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100332024-12-21T07:56:30.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ad6522c-866b-4eb8-85f8-f1ed5703023d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100342024-12-21T07:56:31.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bf8da50d-d0e2-4fbf-aa11-cb0bf9d37c8c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100352024-12-21T07:56:31.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bf8da50d-d0e2-4fbf-aa11-cb0bf9d37c8c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100362024-12-21T07:56:31.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bf8da50d-d0e2-4fbf-aa11-cb0bf9d37c8c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100372024-12-21T07:56:32.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4af3b112-1c47-4ece-87e1-e153fef3dbe3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100382024-12-21T07:56:32.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4af3b112-1c47-4ece-87e1-e153fef3dbe3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100392024-12-21T07:56:32.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4af3b112-1c47-4ece-87e1-e153fef3dbe3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100402024-12-21T07:56:33.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e33740f1-481f-4e22-996a-91f25c909d7e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100412024-12-21T07:56:33.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e33740f1-481f-4e22-996a-91f25c909d7e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100422024-12-21T07:56:33.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e33740f1-481f-4e22-996a-91f25c909d7e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100432024-12-21T07:56:33.582ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
100442024-12-21T07:56:33.582ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
100452024-12-21T07:56:33.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100462024-12-21T07:56:33.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100472024-12-21T07:56:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100482024-12-21T07:56:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100492024-12-21T07:56:33.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100502024-12-21T07:56:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100512024-12-21T07:56:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100522024-12-21T07:56:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100532024-12-21T07:56:33.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100542024-12-21T07:56:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100552024-12-21T07:56:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100562024-12-21T07:56:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100572024-12-21T07:56:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100582024-12-21T07:56:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
100592024-12-21T07:56:33.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100602024-12-21T07:56:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100612024-12-21T07:56:33.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
100622024-12-21T07:56:33.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.464838ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
100632024-12-21T07:56:33.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.432691ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100642024-12-21T07:56:34.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc6f0cfb-a0ef-4d64-b518-3320fbf2bf32 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100652024-12-21T07:56:34.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc6f0cfb-a0ef-4d64-b518-3320fbf2bf32 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100662024-12-21T07:56:34.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc6f0cfb-a0ef-4d64-b518-3320fbf2bf32 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100672024-12-21T07:56:35.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca43b552-d81a-43c4-831b-0d189f137389 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100682024-12-21T07:56:35.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca43b552-d81a-43c4-831b-0d189f137389 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100692024-12-21T07:56:35.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ca43b552-d81a-43c4-831b-0d189f137389 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100702024-12-21T07:56:35.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 92ae4c49-d97a-4d16-a29d-26c5882c1dd6 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
100712024-12-21T07:56:35.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 92ae4c49-d97a-4d16-a29d-26c5882c1dd6 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
100722024-12-21T07:56:35.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 92ae4c49-d97a-4d16-a29d-26c5882c1dd6 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
100732024-12-21T07:56:35.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 44728708-bc8e-421b-83f7-b093578f8dec roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
100742024-12-21T07:56:35.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 44728708-bc8e-421b-83f7-b093578f8dec resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
100752024-12-21T07:56:35.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 44728708-bc8e-421b-83f7-b093578f8dec response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
100762024-12-21T07:56:35.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = d691159e-4238-4d5d-84b1-e0fdcf2eb11e response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
100772024-12-21T07:56:36.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19cc0687-3394-4e66-a1f7-3462ed94af34 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100782024-12-21T07:56:36.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19cc0687-3394-4e66-a1f7-3462ed94af34 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100792024-12-21T07:56:36.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19cc0687-3394-4e66-a1f7-3462ed94af34 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100802024-12-21T07:56:37.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 000a8422-1681-4b97-ac02-b6dfda504d0f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100812024-12-21T07:56:37.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 000a8422-1681-4b97-ac02-b6dfda504d0f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100822024-12-21T07:56:37.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 000a8422-1681-4b97-ac02-b6dfda504d0f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100832024-12-21T07:56:38.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 01244690-0ee5-4950-aaa2-dbf2943e304b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100842024-12-21T07:56:38.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 01244690-0ee5-4950-aaa2-dbf2943e304b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100852024-12-21T07:56:38.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 01244690-0ee5-4950-aaa2-dbf2943e304b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100862024-12-21T07:56:39.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fa40fe9-6036-4a04-806a-c31a9489a264 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100872024-12-21T07:56:39.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fa40fe9-6036-4a04-806a-c31a9489a264 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100882024-12-21T07:56:39.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4fa40fe9-6036-4a04-806a-c31a9489a264 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100892024-12-21T07:56:40.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1d2493e4-007c-4293-9d1a-703e43def287 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100902024-12-21T07:56:40.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1d2493e4-007c-4293-9d1a-703e43def287 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100912024-12-21T07:56:40.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1d2493e4-007c-4293-9d1a-703e43def287 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100922024-12-21T07:56:41.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50458aff-26be-40e0-ad1e-03c474e921bd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100932024-12-21T07:56:41.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50458aff-26be-40e0-ad1e-03c474e921bd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100942024-12-21T07:56:41.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50458aff-26be-40e0-ad1e-03c474e921bd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100952024-12-21T07:56:42.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 71e29dd0-c731-48b0-a24e-4b450514a7c9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100962024-12-21T07:56:42.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 71e29dd0-c731-48b0-a24e-4b450514a7c9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100972024-12-21T07:56:42.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 71e29dd0-c731-48b0-a24e-4b450514a7c9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
100982024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
100992024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
101002024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101012024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101022024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101032024-12-21T07:56:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101042024-12-21T07:56:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101052024-12-21T07:56:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101062024-12-21T07:56:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101072024-12-21T07:56:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101082024-12-21T07:56:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101092024-12-21T07:56:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101102024-12-21T07:56:43.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101112024-12-21T07:56:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
101122024-12-21T07:56:43.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101132024-12-21T07:56:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101142024-12-21T07:56:43.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
101152024-12-21T07:56:43.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.395046ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
101162024-12-21T07:56:43.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101172024-12-21T07:56:43.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101182024-12-21T07:56:43.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.854952ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101192024-12-21T07:56:43.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = afe97cea-a59c-48d6-81d8-5117b3ad0298 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101202024-12-21T07:56:43.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = afe97cea-a59c-48d6-81d8-5117b3ad0298 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101212024-12-21T07:56:43.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = afe97cea-a59c-48d6-81d8-5117b3ad0298 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101222024-12-21T07:56:44.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f01f7f91-963c-4126-9283-a43c30a91fae roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101232024-12-21T07:56:44.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f01f7f91-963c-4126-9283-a43c30a91fae resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101242024-12-21T07:56:44.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f01f7f91-963c-4126-9283-a43c30a91fae response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101252024-12-21T07:56:45.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352df8b0-b5b5-4d37-9195-65efa45a04f3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101262024-12-21T07:56:45.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352df8b0-b5b5-4d37-9195-65efa45a04f3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101272024-12-21T07:56:45.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 352df8b0-b5b5-4d37-9195-65efa45a04f3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101282024-12-21T07:56:45.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 841 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 0c53aa8f-d421-43be-90f7-877be54a4469 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
101292024-12-21T07:56:46.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 056bfcf4-4292-4cee-83b8-74eeab965ffc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101302024-12-21T07:56:46.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 056bfcf4-4292-4cee-83b8-74eeab965ffc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101312024-12-21T07:56:46.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 056bfcf4-4292-4cee-83b8-74eeab965ffc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101322024-12-21T07:56:47.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d1cd5bf-ba66-468d-8270-85218d25600a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101332024-12-21T07:56:47.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d1cd5bf-ba66-468d-8270-85218d25600a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101342024-12-21T07:56:47.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7d1cd5bf-ba66-468d-8270-85218d25600a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101352024-12-21T07:56:48.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 54636b88-325f-4246-9e58-e03a84b95c45 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101362024-12-21T07:56:48.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 54636b88-325f-4246-9e58-e03a84b95c45 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101372024-12-21T07:56:48.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 54636b88-325f-4246-9e58-e03a84b95c45 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101382024-12-21T07:56:49.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1403070-2600-4b26-850b-0d000969d953 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101392024-12-21T07:56:49.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1403070-2600-4b26-850b-0d000969d953 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101402024-12-21T07:56:49.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c1403070-2600-4b26-850b-0d000969d953 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101412024-12-21T07:56:50.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f69c32a4-2361-4c46-aef9-3f12d911c8ad roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101422024-12-21T07:56:50.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f69c32a4-2361-4c46-aef9-3f12d911c8ad resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101432024-12-21T07:56:50.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f69c32a4-2361-4c46-aef9-3f12d911c8ad response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101442024-12-21T07:56:50.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 3005d767-113f-4d6c-b288-bfa4e4617603 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
101452024-12-21T07:56:50.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 3005d767-113f-4d6c-b288-bfa4e4617603 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
101462024-12-21T07:56:50.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 3005d767-113f-4d6c-b288-bfa4e4617603 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
101472024-12-21T07:56:50.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 143c664e-453b-49ad-ad87-53346e2d9b6c roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
101482024-12-21T07:56:50.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 143c664e-453b-49ad-ad87-53346e2d9b6c resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
101492024-12-21T07:56:50.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 143c664e-453b-49ad-ad87-53346e2d9b6c response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
101502024-12-21T07:56:51.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04003cad-cb47-41b5-addb-e7bbc26fa33d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101512024-12-21T07:56:51.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04003cad-cb47-41b5-addb-e7bbc26fa33d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101522024-12-21T07:56:51.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04003cad-cb47-41b5-addb-e7bbc26fa33d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101532024-12-21T07:56:52.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10770d53-d052-4159-84cc-4c000085ab66 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101542024-12-21T07:56:52.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10770d53-d052-4159-84cc-4c000085ab66 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101552024-12-21T07:56:52.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 10770d53-d052-4159-84cc-4c000085ab66 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
101562024-12-21T07:56:53.582ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
101572024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101582024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
101592024-12-21T07:56:53.583ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101602024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
101612024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101622024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
101632024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101642024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101652024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101662024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
101672024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101682024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101692024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101702024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101712024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101722024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
101732024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101742024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101752024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101762024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
101772024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
101782024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
101792024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101802024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101812024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101822024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101832024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
101842024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101852024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
101862024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101872024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
101882024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101892024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
101902024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101912024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101922024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101932024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101942024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101952024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101962024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101972024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101982024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101992024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102002024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102012024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102022024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102032024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102042024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102052024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102062024-12-21T07:56:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102072024-12-21T07:56:53.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102082024-12-21T07:56:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.144885ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
102092024-12-21T07:56:53.587ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.856446ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102102024-12-21T07:56:53.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102112024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102122024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102132024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102142024-12-21T07:56:53.588ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102152024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102162024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102172024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102182024-12-21T07:56:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102192024-12-21T07:56:53.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102202024-12-21T07:56:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102212024-12-21T07:56:53.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102222024-12-21T07:56:53.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102232024-12-21T07:56:53.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 538924417 } })
102242024-12-21T07:56:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102252024-12-21T07:56:53.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102262024-12-21T07:56:53.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102272024-12-21T07:56:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102282024-12-21T07:56:53.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102292024-12-21T07:56:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102302024-12-21T07:56:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102312024-12-21T07:56:53.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102322024-12-21T07:56:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102332024-12-21T07:56:53.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102342024-12-21T07:56:53.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 544699706 } })
102352024-12-21T07:56:53.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102362024-12-21T07:56:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102372024-12-21T07:56:53.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102382024-12-21T07:56:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102392024-12-21T07:56:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.321125ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102402024-12-21T07:56:53.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102412024-12-21T07:56:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102422024-12-21T07:56:53.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102432024-12-21T07:56:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102442024-12-21T07:56:53.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452024-12-21T07:56:53.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102462024-12-21T07:56:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102472024-12-21T07:56:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102482024-12-21T07:56:53.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102492024-12-21T07:56:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102502024-12-21T07:56:53.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102512024-12-21T07:56:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102522024-12-21T07:56:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.181398ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
102532024-12-21T07:56:53.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102542024-12-21T07:56:53.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102552024-12-21T07:56:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102562024-12-21T07:56:53.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102572024-12-21T07:56:53.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102582024-12-21T07:56:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102592024-12-21T07:56:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102602024-12-21T07:56:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102612024-12-21T07:56:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102622024-12-21T07:56:53.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102632024-12-21T07:56:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102642024-12-21T07:56:53.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102652024-12-21T07:56:53.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102662024-12-21T07:56:53.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102672024-12-21T07:56:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102682024-12-21T07:56:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102692024-12-21T07:56:53.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102702024-12-21T07:56:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102712024-12-21T07:56:53.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.165962ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102722024-12-21T07:56:53.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 68.547926ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102732024-12-21T07:56:53.652ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102742024-12-21T07:56:53.652ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.125345ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102752024-12-21T07:56:53.652ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 600304150 } })
102762024-12-21T07:56:53.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
102772024-12-21T07:56:53.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102782024-12-21T07:56:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102792024-12-21T07:56:53.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102802024-12-21T07:56:53.655ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102812024-12-21T07:56:53.655ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102822024-12-21T07:56:53.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102832024-12-21T07:56:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102842024-12-21T07:56:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
102852024-12-21T07:56:53.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102862024-12-21T07:56:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102872024-12-21T07:56:53.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102882024-12-21T07:56:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
102892024-12-21T07:56:53.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102902024-12-21T07:56:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102912024-12-21T07:56:53.670ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102922024-12-21T07:56:53.670ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102932024-12-21T07:56:53.670ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5c570d6-d33c-4299-b02f-fbffd0f5c8d7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
102942024-12-21T07:56:53.670ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102952024-12-21T07:56:53.672ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102962024-12-21T07:56:53.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102972024-12-21T07:56:53.676ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102982024-12-21T07:56:53.676ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bddce435-b5d2-4d51-829a-e81c6a9b8dad", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
102992024-12-21T07:56:53.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103002024-12-21T07:56:53.677ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103012024-12-21T07:56:53.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.847094ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103022024-12-21T07:56:53.725ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.485084ms iteration = 22 status = {"physical_disks_added":0}
103032024-12-21T07:56:53.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103042024-12-21T07:56:53.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103052024-12-21T07:56:53.755ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103062024-12-21T07:56:53.755ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103072024-12-21T07:56:53.755ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5bb297d-012e-460d-82ee-3d38373954e4", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103082024-12-21T07:56:53.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103092024-12-21T07:56:53.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103102024-12-21T07:56:53.758ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 175.46498ms iteration = 20 status = 0
103112024-12-21T07:56:53.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103122024-12-21T07:56:53.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103132024-12-21T07:56:53.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103142024-12-21T07:56:53.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103152024-12-21T07:56:53.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
103162024-12-21T07:56:53.761ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103172024-12-21T07:56:53.762ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6fbd59-3742-4177-b430-5821bc7aa95d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103182024-12-21T07:56:53.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103192024-12-21T07:56:53.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
103202024-12-21T07:56:53.771ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
103212024-12-21T07:56:53.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 188.472803ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
103222024-12-21T07:56:53.775ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.163306ms iteration = 20 status = {}
103232024-12-21T07:56:53.776ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103242024-12-21T07:56:53.776ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "60344850-748a-49fc-8427-833e13456619", "content-length": "1", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103252024-12-21T07:56:53.778ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103262024-12-21T07:56:53.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103272024-12-21T07:56:53.780ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.361716ms iteration = 20 status = null
103282024-12-21T07:56:53.791ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103292024-12-21T07:56:53.791ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103302024-12-21T07:56:53.791ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 208.174461ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103312024-12-21T07:56:53.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322024-12-21T07:56:53.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103332024-12-21T07:56:53.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103342024-12-21T07:56:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103352024-12-21T07:56:53.806ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103362024-12-21T07:56:53.806ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103372024-12-21T07:56:53.806ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a32d6ac3-d63a-4d2a-ac95-7339308d2055", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103382024-12-21T07:56:53.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103392024-12-21T07:56:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103402024-12-21T07:56:53.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103412024-12-21T07:56:53.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103422024-12-21T07:56:53.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103432024-12-21T07:56:53.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103442024-12-21T07:56:53.817ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103452024-12-21T07:56:53.817ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103462024-12-21T07:56:53.817ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4a7c8465-3c68-4b31-aee4-f6543cd1e167", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103472024-12-21T07:56:53.818ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.998798ms iteration = 20 status = {}
103482024-12-21T07:56:53.842ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103492024-12-21T07:56:53.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103502024-12-21T07:56:53.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103512024-12-21T07:56:53.880ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
103522024-12-21T07:56:53.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103532024-12-21T07:56:53.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103542024-12-21T07:56:53.892ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103552024-12-21T07:56:53.892ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "88aa260c-26b7-43d5-b673-80602b0ae6e3", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103562024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103572024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
103582024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103592024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103602024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103612024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103622024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103632024-12-21T07:56:53.892ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103642024-12-21T07:56:53.893ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103652024-12-21T07:56:53.893ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103662024-12-21T07:56:53.893ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
103672024-12-21T07:56:53.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103682024-12-21T07:56:53.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103692024-12-21T07:56:53.896ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103702024-12-21T07:56:53.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47b5510-b393-4df2-b5a0-657d3b3e5a36", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103712024-12-21T07:56:53.896ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103722024-12-21T07:56:53.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7b335ef-bf34-4bed-a51b-f25196465713", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103732024-12-21T07:56:53.896ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
103742024-12-21T07:56:53.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103752024-12-21T07:56:53.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 75eb1aae-a76e-4103-8430-f8801995184e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103762024-12-21T07:56:53.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 75eb1aae-a76e-4103-8430-f8801995184e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103772024-12-21T07:56:53.927ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2c59078-6dbb-4f39-bc6c-3c4086b1ed03", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103782024-12-21T07:56:53.927ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103792024-12-21T07:56:53.928ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103802024-12-21T07:56:53.928ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103812024-12-21T07:56:53.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 75eb1aae-a76e-4103-8430-f8801995184e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103822024-12-21T07:56:53.929ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 346.932211ms iteration = 20 status = {}
103832024-12-21T07:56:54.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f69c3868-2d05-4245-b615-dfcce5da2026", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103842024-12-21T07:56:54.106ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
103852024-12-21T07:56:54.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103862024-12-21T07:56:54.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8615e3a4-65b8-444a-8c0a-cff94550cb1f", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
103872024-12-21T07:56:54.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103882024-12-21T07:56:54.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103892024-12-21T07:56:54.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103902024-12-21T07:56:54.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103912024-12-21T07:56:54.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103922024-12-21T07:56:54.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103932024-12-21T07:56:54.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103942024-12-21T07:56:54.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103952024-12-21T07:56:54.123ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 540.106273ms iteration = 20 status = {}
103962024-12-21T07:56:54.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30e65e59-9b0e-4f11-8fc3-54d80cce4a3e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103972024-12-21T07:56:54.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30e65e59-9b0e-4f11-8fc3-54d80cce4a3e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103982024-12-21T07:56:54.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 30e65e59-9b0e-4f11-8fc3-54d80cce4a3e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
103992024-12-21T07:56:55.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 716 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 279d0523-13e8-4d05-ae3f-222b7ceb1486 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
104002024-12-21T07:56:55.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e5356bd-4616-4563-805e-1b9652dd74b7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104012024-12-21T07:56:55.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e5356bd-4616-4563-805e-1b9652dd74b7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104022024-12-21T07:56:55.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7e5356bd-4616-4563-805e-1b9652dd74b7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104032024-12-21T07:56:56.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f729b09f-a209-433e-a073-be5a2ad1258d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104042024-12-21T07:56:56.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f729b09f-a209-433e-a073-be5a2ad1258d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104052024-12-21T07:56:56.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f729b09f-a209-433e-a073-be5a2ad1258d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104062024-12-21T07:56:58.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fd834e1e-9ca9-4a6e-912d-beab1423e412 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104072024-12-21T07:56:58.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fd834e1e-9ca9-4a6e-912d-beab1423e412 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104082024-12-21T07:56:58.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fd834e1e-9ca9-4a6e-912d-beab1423e412 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104092024-12-21T07:56:59.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8703904-5df6-4d23-b88e-0a461f0ece8d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104102024-12-21T07:56:59.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8703904-5df6-4d23-b88e-0a461f0ece8d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104112024-12-21T07:56:59.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f8703904-5df6-4d23-b88e-0a461f0ece8d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104122024-12-21T07:57:00.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbf02dc5-35c5-4125-9926-3b9bd6ae5a0d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104132024-12-21T07:57:00.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbf02dc5-35c5-4125-9926-3b9bd6ae5a0d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104142024-12-21T07:57:00.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fbf02dc5-35c5-4125-9926-3b9bd6ae5a0d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104152024-12-21T07:57:01.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff2ba590-6c99-4ca1-ab82-7d0913990189 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104162024-12-21T07:57:01.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff2ba590-6c99-4ca1-ab82-7d0913990189 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104172024-12-21T07:57:01.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ff2ba590-6c99-4ca1-ab82-7d0913990189 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104182024-12-21T07:57:02.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e9373a2-c9a5-4c16-9657-a2deb1ee1e8d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104192024-12-21T07:57:02.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e9373a2-c9a5-4c16-9657-a2deb1ee1e8d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104202024-12-21T07:57:02.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9e9373a2-c9a5-4c16-9657-a2deb1ee1e8d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104212024-12-21T07:57:03.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fca24520-21b2-4bf2-adef-4c9c0137516d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104222024-12-21T07:57:03.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fca24520-21b2-4bf2-adef-4c9c0137516d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104232024-12-21T07:57:03.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fca24520-21b2-4bf2-adef-4c9c0137516d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104242024-12-21T07:57:03.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
104252024-12-21T07:57:03.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
104262024-12-21T07:57:03.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104272024-12-21T07:57:03.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104282024-12-21T07:57:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104292024-12-21T07:57:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104302024-12-21T07:57:03.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104312024-12-21T07:57:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104322024-12-21T07:57:03.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.321227ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104332024-12-21T07:57:03.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104342024-12-21T07:57:03.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104352024-12-21T07:57:03.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104362024-12-21T07:57:03.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104372024-12-21T07:57:03.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104382024-12-21T07:57:03.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104392024-12-21T07:57:03.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104402024-12-21T07:57:03.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
104412024-12-21T07:57:03.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104422024-12-21T07:57:03.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104432024-12-21T07:57:03.634ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
104442024-12-21T07:57:03.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.479837ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
104452024-12-21T07:57:04.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eb4b948e-e0a1-47ab-b9de-38d92348a661 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104462024-12-21T07:57:04.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eb4b948e-e0a1-47ab-b9de-38d92348a661 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104472024-12-21T07:57:04.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = eb4b948e-e0a1-47ab-b9de-38d92348a661 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104482024-12-21T07:57:05.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b87f267-bf64-4a18-a8d7-76d89246fc77 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104492024-12-21T07:57:05.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b87f267-bf64-4a18-a8d7-76d89246fc77 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104502024-12-21T07:57:05.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1b87f267-bf64-4a18-a8d7-76d89246fc77 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104512024-12-21T07:57:05.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = ff9a85bf-147c-42b8-8820-78eadb8dad73 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
104522024-12-21T07:57:05.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = ff9a85bf-147c-42b8-8820-78eadb8dad73 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
104532024-12-21T07:57:05.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = ff9a85bf-147c-42b8-8820-78eadb8dad73 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
104542024-12-21T07:57:05.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = b3fde37f-99f4-4519-a18d-e1396a4aa9cd roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
104552024-12-21T07:57:05.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = b3fde37f-99f4-4519-a18d-e1396a4aa9cd resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
104562024-12-21T07:57:05.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = b3fde37f-99f4-4519-a18d-e1396a4aa9cd response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
104572024-12-21T07:57:05.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = e7d1a257-7b1f-4cf3-8608-539feb890641 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
104582024-12-21T07:57:06.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5dde25c6-86ec-4fb6-bc2c-067109892597 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104592024-12-21T07:57:06.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5dde25c6-86ec-4fb6-bc2c-067109892597 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104602024-12-21T07:57:06.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5dde25c6-86ec-4fb6-bc2c-067109892597 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104612024-12-21T07:57:07.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6442263-8859-4b64-bedb-c4a37d33e049 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104622024-12-21T07:57:07.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6442263-8859-4b64-bedb-c4a37d33e049 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104632024-12-21T07:57:07.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f6442263-8859-4b64-bedb-c4a37d33e049 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104642024-12-21T07:57:08.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81bf7667-2ab1-4591-a204-4162a636671a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104652024-12-21T07:57:08.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81bf7667-2ab1-4591-a204-4162a636671a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104662024-12-21T07:57:08.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 81bf7667-2ab1-4591-a204-4162a636671a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104672024-12-21T07:57:09.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a852ac6-d50b-4d97-8dc7-2aefb8437186 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104682024-12-21T07:57:09.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a852ac6-d50b-4d97-8dc7-2aefb8437186 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104692024-12-21T07:57:09.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a852ac6-d50b-4d97-8dc7-2aefb8437186 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104702024-12-21T07:57:10.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80299a06-3a91-4291-85c4-bab54ec14480 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104712024-12-21T07:57:10.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80299a06-3a91-4291-85c4-bab54ec14480 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104722024-12-21T07:57:10.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 80299a06-3a91-4291-85c4-bab54ec14480 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104732024-12-21T07:57:11.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc0fbad1-7d63-4f4e-9a5e-960348682dde roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104742024-12-21T07:57:11.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc0fbad1-7d63-4f4e-9a5e-960348682dde resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104752024-12-21T07:57:11.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fc0fbad1-7d63-4f4e-9a5e-960348682dde response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104762024-12-21T07:57:12.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19e5bab9-7a3a-47d2-94f5-7f89b9a1a47b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104772024-12-21T07:57:12.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19e5bab9-7a3a-47d2-94f5-7f89b9a1a47b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104782024-12-21T07:57:12.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 19e5bab9-7a3a-47d2-94f5-7f89b9a1a47b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104792024-12-21T07:57:13.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4e037b04-5622-4e02-b772-87f24bfd0258 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104802024-12-21T07:57:13.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4e037b04-5622-4e02-b772-87f24bfd0258 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104812024-12-21T07:57:13.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4e037b04-5622-4e02-b772-87f24bfd0258 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
104822024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
104832024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104842024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
104852024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104862024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104872024-12-21T07:57:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104882024-12-21T07:57:13.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104892024-12-21T07:57:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104902024-12-21T07:57:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104912024-12-21T07:57:13.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.018399ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104922024-12-21T07:57:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104932024-12-21T07:57:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104942024-12-21T07:57:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104952024-12-21T07:57:13.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104962024-12-21T07:57:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104972024-12-21T07:57:13.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104982024-12-21T07:57:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
104992024-12-21T07:57:13.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105002024-12-21T07:57:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105012024-12-21T07:57:13.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
105022024-12-21T07:57:13.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.878374ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
105032024-12-21T07:57:14.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fcd27a-08cd-4e37-a84a-f05f8603572e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105042024-12-21T07:57:14.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fcd27a-08cd-4e37-a84a-f05f8603572e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105052024-12-21T07:57:14.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57fcd27a-08cd-4e37-a84a-f05f8603572e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105062024-12-21T07:57:15.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7230dad-9d22-4799-a584-b66498c68eea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105072024-12-21T07:57:15.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7230dad-9d22-4799-a584-b66498c68eea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105082024-12-21T07:57:15.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c7230dad-9d22-4799-a584-b66498c68eea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105092024-12-21T07:57:15.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 7abd65c1-40cc-486c-bb2f-94fa8668d69f response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
105102024-12-21T07:57:16.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e9fdc77-44c0-4056-9942-02d99db3c34a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105112024-12-21T07:57:16.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e9fdc77-44c0-4056-9942-02d99db3c34a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105122024-12-21T07:57:16.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6e9fdc77-44c0-4056-9942-02d99db3c34a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105132024-12-21T07:57:17.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0facc8d-5903-4771-a2bf-1a4ef36a98a0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105142024-12-21T07:57:17.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0facc8d-5903-4771-a2bf-1a4ef36a98a0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105152024-12-21T07:57:17.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0facc8d-5903-4771-a2bf-1a4ef36a98a0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105162024-12-21T07:57:18.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0468210-f72c-47a6-8b62-18e77088d47f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105172024-12-21T07:57:18.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0468210-f72c-47a6-8b62-18e77088d47f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105182024-12-21T07:57:18.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a0468210-f72c-47a6-8b62-18e77088d47f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105192024-12-21T07:57:19.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48596645-9a33-4db0-bd84-bc49b73aca0d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105202024-12-21T07:57:19.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48596645-9a33-4db0-bd84-bc49b73aca0d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105212024-12-21T07:57:19.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48596645-9a33-4db0-bd84-bc49b73aca0d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105222024-12-21T07:57:20.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac8fac50-1a09-42ab-8491-da89732e3f06 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105232024-12-21T07:57:20.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac8fac50-1a09-42ab-8491-da89732e3f06 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105242024-12-21T07:57:20.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ac8fac50-1a09-42ab-8491-da89732e3f06 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105252024-12-21T07:57:21.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a549517-d538-48e7-bf91-0b7eb36e7064 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105262024-12-21T07:57:21.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a549517-d538-48e7-bf91-0b7eb36e7064 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105272024-12-21T07:57:21.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3a549517-d538-48e7-bf91-0b7eb36e7064 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105282024-12-21T07:57:22.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb19f541-d202-409d-9576-1be5359d7f23 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105292024-12-21T07:57:22.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb19f541-d202-409d-9576-1be5359d7f23 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105302024-12-21T07:57:22.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb19f541-d202-409d-9576-1be5359d7f23 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105312024-12-21T07:57:23.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b1a3d73-6a5f-4cdc-b6bf-342e0d1cfd86 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105322024-12-21T07:57:23.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b1a3d73-6a5f-4cdc-b6bf-342e0d1cfd86 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105332024-12-21T07:57:23.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6b1a3d73-6a5f-4cdc-b6bf-342e0d1cfd86 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
105342024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
105352024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105362024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
105372024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105382024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
105392024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105402024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
105412024-12-21T07:57:23.583ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
105422024-12-21T07:57:23.583ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
105432024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
105442024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
105452024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105462024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105472024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
105482024-12-21T07:57:23.583ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105492024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105502024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
105512024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
105522024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105532024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
105542024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105552024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105562024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
105572024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105582024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
105592024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105602024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
105612024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
105622024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105632024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
105642024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105652024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
105662024-12-21T07:57:23.583ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:47:23.583716867 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105672024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105682024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
105692024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
105702024-12-21T07:57:23.583ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
105712024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
105722024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105732024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
105742024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105752024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105762024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
105772024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
105782024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105792024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
105802024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105812024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
105822024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105832024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
105842024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105852024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105862024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
105872024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105882024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
105892024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105902024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
105912024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105922024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
105932024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105942024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
105952024-12-21T07:57:23.584ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105962024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105972024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
105982024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105992024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
106002024-12-21T07:57:23.584ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
106012024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.45\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
106022024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
106032024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106042024-12-21T07:57:23.584ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
106052024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106062024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106072024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106082024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106092024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106102024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106112024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106122024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106132024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106142024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106152024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106162024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106172024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106182024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106192024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106202024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106212024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106222024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106232024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106242024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106252024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106262024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106272024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106282024-12-21T07:57:23.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 531790544 } })
106292024-12-21T07:57:23.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 531804565 } })
106302024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
106312024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.284482ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
106322024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
106332024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.77434ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
106342024-12-21T07:57:23.591ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106352024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106362024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106372024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106382024-12-21T07:57:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.270172ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106392024-12-21T07:57:23.593ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.553604ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
106402024-12-21T07:57:23.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412024-12-21T07:57:23.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106422024-12-21T07:57:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106432024-12-21T07:57:23.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106442024-12-21T07:57:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106452024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106462024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106472024-12-21T07:57:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106482024-12-21T07:57:23.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106492024-12-21T07:57:23.601ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:47:23.583716867 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106502024-12-21T07:57:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.004789ms iteration = 11 status = {"expiration":"2024-12-21T07:47:23.583716867Z","pruned":[]}
106512024-12-21T07:57:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106522024-12-21T07:57:23.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106532024-12-21T07:57:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106542024-12-21T07:57:23.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106552024-12-21T07:57:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106562024-12-21T07:57:23.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106572024-12-21T07:57:23.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 560779312 } })
106582024-12-21T07:57:23.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
106592024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106602024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106612024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106622024-12-21T07:57:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106632024-12-21T07:57:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106642024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106652024-12-21T07:57:23.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106662024-12-21T07:57:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106672024-12-21T07:57:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106682024-12-21T07:57:23.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 570105632 } })
106692024-12-21T07:57:23.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106702024-12-21T07:57:23.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106712024-12-21T07:57:23.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106722024-12-21T07:57:23.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106732024-12-21T07:57:23.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106742024-12-21T07:57:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106752024-12-21T07:57:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106762024-12-21T07:57:23.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106772024-12-21T07:57:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106782024-12-21T07:57:23.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106792024-12-21T07:57:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106802024-12-21T07:57:23.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106812024-12-21T07:57:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106822024-12-21T07:57:23.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 591429247 } })
106832024-12-21T07:57:23.644ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
106842024-12-21T07:57:23.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106852024-12-21T07:57:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106862024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106872024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106882024-12-21T07:57:23.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106892024-12-21T07:57:23.664ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
106902024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 81.558259ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
106912024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106922024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106932024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
106942024-12-21T07:57:23.665ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
106952024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.876875ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
106962024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106972024-12-21T07:57:23.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106982024-12-21T07:57:23.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106992024-12-21T07:57:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107002024-12-21T07:57:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107012024-12-21T07:57:23.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107022024-12-21T07:57:23.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107032024-12-21T07:57:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107042024-12-21T07:57:23.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107052024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
107062024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107072024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107082024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107092024-12-21T07:57:23.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107102024-12-21T07:57:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107112024-12-21T07:57:23.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107122024-12-21T07:57:23.680ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107132024-12-21T07:57:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107142024-12-21T07:57:23.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107152024-12-21T07:57:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 99.020628ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
107162024-12-21T07:57:23.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107172024-12-21T07:57:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107182024-12-21T07:57:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 100.686698ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
107192024-12-21T07:57:23.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107202024-12-21T07:57:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.677141ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107212024-12-21T07:57:23.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107222024-12-21T07:57:23.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107232024-12-21T07:57:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107242024-12-21T07:57:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107252024-12-21T07:57:23.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107262024-12-21T07:57:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107272024-12-21T07:57:23.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107282024-12-21T07:57:23.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107292024-12-21T07:57:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107302024-12-21T07:57:23.697ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107312024-12-21T07:57:23.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107322024-12-21T07:57:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107332024-12-21T07:57:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
107342024-12-21T07:57:23.700ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107352024-12-21T07:57:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107362024-12-21T07:57:23.703ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107372024-12-21T07:57:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107382024-12-21T07:57:23.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107392024-12-21T07:57:23.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107402024-12-21T07:57:23.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107412024-12-21T07:57:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107422024-12-21T07:57:23.712ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107432024-12-21T07:57:23.712ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107442024-12-21T07:57:23.712ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107452024-12-21T07:57:23.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107462024-12-21T07:57:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107472024-12-21T07:57:23.713ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
107482024-12-21T07:57:23.713ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.609323ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
107492024-12-21T07:57:23.714ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107502024-12-21T07:57:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.990557ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107512024-12-21T07:57:23.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107522024-12-21T07:57:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107532024-12-21T07:57:23.723ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107542024-12-21T07:57:23.723ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107552024-12-21T07:57:23.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107562024-12-21T07:57:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107572024-12-21T07:57:23.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107582024-12-21T07:57:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107592024-12-21T07:57:23.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107602024-12-21T07:57:23.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107612024-12-21T07:57:23.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107622024-12-21T07:57:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107632024-12-21T07:57:23.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 172.717303ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107642024-12-21T07:57:23.760ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
107652024-12-21T07:57:23.781ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107662024-12-21T07:57:23.781ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107672024-12-21T07:57:23.781ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107682024-12-21T07:57:23.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107692024-12-21T07:57:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107702024-12-21T07:57:23.792ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107712024-12-21T07:57:23.792ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107722024-12-21T07:57:23.792ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eebb1a1-5017-4b74-b6d9-c2f3aad91041", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
107732024-12-21T07:57:23.792ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107742024-12-21T07:57:23.794ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107752024-12-21T07:57:23.831ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.430454ms iteration = 23 status = {"physical_disks_added":0}
107762024-12-21T07:57:23.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
107772024-12-21T07:57:23.841ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107782024-12-21T07:57:23.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97b11ee-8f1a-4847-b8df-2cb6926ede4a", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
107792024-12-21T07:57:23.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107802024-12-21T07:57:23.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
107812024-12-21T07:57:23.893ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107822024-12-21T07:57:23.893ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f97831-eb5d-444b-87c9-51b127b41c45", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
107832024-12-21T07:57:23.893ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
107842024-12-21T07:57:23.893ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
107852024-12-21T07:57:23.893ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
107862024-12-21T07:57:23.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 311.900929ms iteration = 21 status = {}
107872024-12-21T07:57:23.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
107882024-12-21T07:57:23.937ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107892024-12-21T07:57:23.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107902024-12-21T07:57:23.951ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107912024-12-21T07:57:23.951ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ca01b7a-3268-4dff-a840-55f38aaa8a4a", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
107922024-12-21T07:57:23.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107932024-12-21T07:57:23.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107942024-12-21T07:57:23.989ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.010983ms iteration = 21 status = {}
107952024-12-21T07:57:24.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
107962024-12-21T07:57:24.088ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "22fc76d2-d030-489d-8648-d57c7c361fcd", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
107972024-12-21T07:57:24.088ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
107982024-12-21T07:57:24.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c4e768a9-ebaa-42af-b02d-c0623f7b63d1", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
107992024-12-21T07:57:24.090ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
108002024-12-21T07:57:24.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "12e4866f-4ed3-455a-a62d-7fe884db277d", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
108012024-12-21T07:57:24.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
108022024-12-21T07:57:24.094ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
108032024-12-21T07:57:24.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 510.418775ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108042024-12-21T07:57:24.102ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108052024-12-21T07:57:24.102ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd8fc3d9-f272-4add-9ebe-76f520885b2f", "content-length": "1", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
108062024-12-21T07:57:24.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108072024-12-21T07:57:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108082024-12-21T07:57:24.119ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108092024-12-21T07:57:24.119ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108102024-12-21T07:57:24.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108112024-12-21T07:57:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108122024-12-21T07:57:24.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108132024-12-21T07:57:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108142024-12-21T07:57:24.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108152024-12-21T07:57:24.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108162024-12-21T07:57:24.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108172024-12-21T07:57:24.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108182024-12-21T07:57:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108192024-12-21T07:57:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108202024-12-21T07:57:24.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108212024-12-21T07:57:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108222024-12-21T07:57:24.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108232024-12-21T07:57:24.132ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 548.990867ms iteration = 21 status = null
108242024-12-21T07:57:24.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108252024-12-21T07:57:24.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108262024-12-21T07:57:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108272024-12-21T07:57:24.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108282024-12-21T07:57:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108292024-12-21T07:57:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
108302024-12-21T07:57:24.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108312024-12-21T07:57:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108322024-12-21T07:57:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
108332024-12-21T07:57:24.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108342024-12-21T07:57:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108352024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
108362024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
108372024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108382024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108392024-12-21T07:57:24.142ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 558.382268ms iteration = 21 status = 0
108402024-12-21T07:57:24.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108412024-12-21T07:57:24.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108422024-12-21T07:57:24.146ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "81454de6-27d8-4e65-bcfa-872864225570", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108432024-12-21T07:57:24.146ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108442024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108452024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108462024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108472024-12-21T07:57:24.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "76104d19-b730-4e10-8e15-494693c5df20", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108482024-12-21T07:57:24.148ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108492024-12-21T07:57:24.150ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
108502024-12-21T07:57:24.150ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
108512024-12-21T07:57:24.150ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
108522024-12-21T07:57:24.150ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 566.303043ms iteration = 11 status = {"generation":2}
108532024-12-21T07:57:24.150ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108542024-12-21T07:57:24.150ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 567.132147ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108552024-12-21T07:57:24.160ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108562024-12-21T07:57:24.160ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108572024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 577.266601ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108582024-12-21T07:57:24.164ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
108592024-12-21T07:57:24.164ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
108602024-12-21T07:57:24.164ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 580.571218ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
108612024-12-21T07:57:24.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 586.347907ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108622024-12-21T07:57:24.171ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
108632024-12-21T07:57:24.171ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
108642024-12-21T07:57:24.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108652024-12-21T07:57:24.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 587.563967ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108662024-12-21T07:57:24.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108672024-12-21T07:57:24.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108682024-12-21T07:57:24.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108692024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108702024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108712024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108722024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108732024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108742024-12-21T07:57:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108752024-12-21T07:57:24.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108762024-12-21T07:57:24.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108772024-12-21T07:57:24.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108782024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108792024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108802024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
108812024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 595.479684ms iteration = 11 status = {"generation":1}
108822024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108832024-12-21T07:57:24.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108842024-12-21T07:57:24.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108852024-12-21T07:57:24.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108862024-12-21T07:57:24.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108872024-12-21T07:57:24.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108882024-12-21T07:57:24.182ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
108892024-12-21T07:57:24.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108902024-12-21T07:57:24.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108912024-12-21T07:57:24.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108922024-12-21T07:57:24.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108932024-12-21T07:57:24.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108942024-12-21T07:57:24.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108952024-12-21T07:57:24.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108962024-12-21T07:57:24.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108972024-12-21T07:57:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108982024-12-21T07:57:24.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108992024-12-21T07:57:24.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109002024-12-21T07:57:24.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109012024-12-21T07:57:24.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52151634-d742-4fc8-a750-49b4cda1305b", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
109022024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109032024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
109042024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109052024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109062024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109072024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109082024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109092024-12-21T07:57:24.192ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109102024-12-21T07:57:24.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109112024-12-21T07:57:24.193ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109122024-12-21T07:57:24.193ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109132024-12-21T07:57:24.193ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
109142024-12-21T07:57:24.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109152024-12-21T07:57:24.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109162024-12-21T07:57:24.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109172024-12-21T07:57:24.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109182024-12-21T07:57:24.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109192024-12-21T07:57:24.196ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109202024-12-21T07:57:24.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109212024-12-21T07:57:24.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6fe1544-1bea-4510-87a8-fe47bb109ced", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
109222024-12-21T07:57:24.196ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109232024-12-21T07:57:24.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b22c9a4b-422d-47b4-ae90-07fdb30f5e7d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
109242024-12-21T07:57:24.196ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
109252024-12-21T07:57:24.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109262024-12-21T07:57:24.196ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109272024-12-21T07:57:24.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109282024-12-21T07:57:24.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
109292024-12-21T07:57:24.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109302024-12-21T07:57:24.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109312024-12-21T07:57:24.201ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
109322024-12-21T07:57:24.202ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 618.425287ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
109332024-12-21T07:57:24.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109342024-12-21T07:57:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109352024-12-21T07:57:24.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109362024-12-21T07:57:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109372024-12-21T07:57:24.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109382024-12-21T07:57:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109392024-12-21T07:57:24.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109402024-12-21T07:57:24.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109412024-12-21T07:57:24.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109422024-12-21T07:57:24.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109432024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109442024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
109452024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 629.075929ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
109462024-12-21T07:57:24.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109472024-12-21T07:57:24.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109482024-12-21T07:57:24.218ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109492024-12-21T07:57:24.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109502024-12-21T07:57:24.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109512024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "11d982b5-c312-49da-8ce2-7f5c7dd995fa", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
109522024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109532024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109542024-12-21T07:57:24.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109552024-12-21T07:57:24.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109562024-12-21T07:57:24.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109572024-12-21T07:57:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109582024-12-21T07:57:24.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109592024-12-21T07:57:24.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109602024-12-21T07:57:24.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109612024-12-21T07:57:24.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109622024-12-21T07:57:24.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109632024-12-21T07:57:24.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109642024-12-21T07:57:24.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109652024-12-21T07:57:24.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109662024-12-21T07:57:24.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109672024-12-21T07:57:24.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109682024-12-21T07:57:24.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109692024-12-21T07:57:24.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109702024-12-21T07:57:24.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109712024-12-21T07:57:24.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109722024-12-21T07:57:24.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109732024-12-21T07:57:24.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109742024-12-21T07:57:24.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109752024-12-21T07:57:24.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109762024-12-21T07:57:24.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109772024-12-21T07:57:24.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109782024-12-21T07:57:24.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109792024-12-21T07:57:24.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109802024-12-21T07:57:24.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109812024-12-21T07:57:24.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109822024-12-21T07:57:24.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109832024-12-21T07:57:24.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109842024-12-21T07:57:24.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109852024-12-21T07:57:24.290ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109862024-12-21T07:57:24.290ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109872024-12-21T07:57:24.291ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "81b919db-70c4-4732-8d95-6cb3c67e58fe", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
109882024-12-21T07:57:24.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109892024-12-21T07:57:24.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109902024-12-21T07:57:24.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109912024-12-21T07:57:24.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109922024-12-21T07:57:24.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109932024-12-21T07:57:24.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109942024-12-21T07:57:24.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109952024-12-21T07:57:24.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109962024-12-21T07:57:24.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109972024-12-21T07:57:24.298ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
109982024-12-21T07:57:24.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109992024-12-21T07:57:24.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110002024-12-21T07:57:24.300ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110012024-12-21T07:57:24.300ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110022024-12-21T07:57:24.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110032024-12-21T07:57:24.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
110042024-12-21T07:57:24.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110052024-12-21T07:57:24.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110062024-12-21T07:57:24.304ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
110072024-12-21T07:57:24.304ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
110082024-12-21T07:57:24.304ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
110092024-12-21T07:57:24.306ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6e83df5a-4b75-4a42-b022-4115190818f5", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
110102024-12-21T07:57:24.308ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 724.569697ms iteration = 21 status = {}
110112024-12-21T07:57:24.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8ea3aeca-55d3-4a91-9c96-29b9b3c3766a", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
110122024-12-21T07:57:24.362ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
110132024-12-21T07:57:24.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110142024-12-21T07:57:24.367ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4cb398-8ecd-4863-9d5a-ca80ce0e0807", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
110152024-12-21T07:57:24.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110162024-12-21T07:57:24.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110172024-12-21T07:57:24.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110182024-12-21T07:57:24.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110192024-12-21T07:57:24.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110202024-12-21T07:57:24.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110212024-12-21T07:57:24.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110222024-12-21T07:57:24.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110232024-12-21T07:57:24.384ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.962108ms iteration = 21 status = {}
110242024-12-21T07:57:24.417ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110252024-12-21T07:57:24.417ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110262024-12-21T07:57:24.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110272024-12-21T07:57:24.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110282024-12-21T07:57:24.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110292024-12-21T07:57:24.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110302024-12-21T07:57:24.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110312024-12-21T07:57:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
110322024-12-21T07:57:24.455ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110332024-12-21T07:57:24.456ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3639b551-5265-4e5a-a2b7-80f263014914", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
110342024-12-21T07:57:24.458ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
110352024-12-21T07:57:24.458ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 875.108509ms
110362024-12-21T07:57:24.458ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 875.117299ms iteration = 3 status = {}
110372024-12-21T07:57:24.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bc7a4814-ff12-4f9a-934d-03540d74b55e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
110382024-12-21T07:57:24.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bc7a4814-ff12-4f9a-934d-03540d74b55e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
110392024-12-21T07:57:24.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bc7a4814-ff12-4f9a-934d-03540d74b55e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
110402024-12-21T07:57:25.007ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110412024-12-21T07:57:25.007ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110422024-12-21T07:57:25.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110432024-12-21T07:57:25.009ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110442024-12-21T07:57:25.011ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110452024-12-21T07:57:25.011ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110462024-12-21T07:57:25.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110472024-12-21T07:57:25.017ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(32aca71e-b39b-47ab-a2c7-b9f0a55c8abc, 0), (5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e, 0), (a343033c-6f51-4865-a2d3-691517e8a95f, 0), (af636983-f06b-4cce-9a71-c121839d7d9b, 0)] collection_id = 32aca71e-b39b-47ab-a2c7-b9f0a55c8abc
110482024-12-21T07:57:25.017ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110492024-12-21T07:57:25.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110502024-12-21T07:57:25.092ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 32aca71e-b39b-47ab-a2c7-b9f0a55c8abc file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
110512024-12-21T07:57:25.092ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110522024-12-21T07:57:25.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110532024-12-21T07:57:25.095ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e, 0), (a343033c-6f51-4865-a2d3-691517e8a95f, 0), (af636983-f06b-4cce-9a71-c121839d7d9b, 0), (fc6e5c67-f858-4351-a36c-8a96e912581a, 0)] collection_id = 5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e
110542024-12-21T07:57:25.095ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110552024-12-21T07:57:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110562024-12-21T07:57:25.154ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
110572024-12-21T07:57:25.154ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110582024-12-21T07:57:25.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110592024-12-21T07:57:25.162ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(a343033c-6f51-4865-a2d3-691517e8a95f, 0), (af636983-f06b-4cce-9a71-c121839d7d9b, 0), (fc6e5c67-f858-4351-a36c-8a96e912581a, 0)]
110602024-12-21T07:57:25.163ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 110540403 } })
110612024-12-21T07:57:25.194ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
110622024-12-21T07:57:25.194ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
110632024-12-21T07:57:25.194ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
110642024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cd22821-85fa-44fe-923e-909c4989b8aa", "content-length": "476", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110652024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
110662024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14531170-8ada-45dd-8fc5-4eef680690ac", "content-length": "734", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110672024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
110682024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "627480c1-9dda-402b-8ca6-2d5a3e0fd45e", "content-length": "111", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110692024-12-21T07:57:25.195ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
110702024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee3ad5bf-da59-4a65-8439-07d30ee1ce9f", "content-length": "111", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110712024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
110722024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30c652a6-5101-4c5d-b268-49c01a132637", "content-length": "167", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110732024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
110742024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eecda65-ae3a-42f9-b8a8-917e3d3d9052", "content-length": "167", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110752024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
110762024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "453d9f04-5a33-4b26-ab33-2adf935f63e7", "content-length": "175", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110772024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
110782024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d8896f9-f878-4cc9-b7f9-61c92cb63b56", "content-length": "175", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110792024-12-21T07:57:25.196ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
110802024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcce4d90-21db-4b27-8e19-6eefb767f457", "content-length": "702", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110812024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110822024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb26972-881e-4a14-9087-43246cc95622", "content-length": "727", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110832024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110842024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49fdab77-a5fd-48d8-be61-538d42d1e8e7", "content-length": "729", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110852024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110862024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5b5370f-5bd4-432a-b612-7ae928809cf1", "content-length": "728", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110872024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
110882024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d54956bd-2235-4d8a-8fd7-28e76be89ec5", "content-length": "722", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110892024-12-21T07:57:25.197ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
110902024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36552feb-77ba-40f7-8079-a027455ad2ff", "content-length": "109", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110912024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
110922024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8d7aa2f-36dc-4af7-b5a2-5a1d2a428c63", "content-length": "109", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110932024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
110942024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c94e476-3aba-4ae1-9ee4-02be0c316521", "content-length": "169", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110952024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
110962024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9449b66f-ca65-44f0-b6ab-3abe127f7995", "content-length": "169", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110972024-12-21T07:57:25.198ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
110982024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc2e0d9f-1e0f-463a-950f-a156ae68aa47", "content-length": "178", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
110992024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
111002024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0abf413-c234-487b-a186-84914c6f2ed9", "content-length": "178", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111012024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
111022024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "792fbdf1-a31a-4a6c-8d8a-320d8e9f2f67", "content-length": "702", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111032024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111042024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d326556-6b9e-4d07-8789-d32cd1d157a0", "content-length": "727", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111052024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111062024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ede68bcb-1b91-4812-965f-07ee0cc85f16", "content-length": "729", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111072024-12-21T07:57:25.199ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111082024-12-21T07:57:25.200ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e21fc9d-b29e-46bd-bdd2-636b1af81edf", "content-length": "728", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111092024-12-21T07:57:25.200ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111102024-12-21T07:57:25.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111112024-12-21T07:57:25.202ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111122024-12-21T07:57:25.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111132024-12-21T07:57:25.203ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111142024-12-21T07:57:25.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111152024-12-21T07:57:25.205ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111162024-12-21T07:57:25.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111172024-12-21T07:57:25.207ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111182024-12-21T07:57:25.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111192024-12-21T07:57:25.299ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
111202024-12-21T07:57:25.299ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
111212024-12-21T07:57:25.503ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca8326d-42c8-4acc-b96a-2212ee692c07", "content-length": "30798", "date": "Sat, 21 Dec 2024 07:57:25 GMT"} })
111222024-12-21T07:57:25.504ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111232024-12-21T07:57:25.504ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111242024-12-21T07:57:25.504ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
111252024-12-21T07:57:25.506ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111262024-12-21T07:57:25.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111272024-12-21T07:57:25.508ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111282024-12-21T07:57:25.510ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111292024-12-21T07:57:25.510ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111302024-12-21T07:57:25.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111312024-12-21T07:57:25.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a58a9363-901b-4838-8789-649c0c5ed255 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111322024-12-21T07:57:25.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a58a9363-901b-4838-8789-649c0c5ed255 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111332024-12-21T07:57:25.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a58a9363-901b-4838-8789-649c0c5ed255 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111342024-12-21T07:57:25.681ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 92b5af3f-85df-41b1-be5a-49676ae9b7f5 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
111352024-12-21T07:57:25.681ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 92b5af3f-85df-41b1-be5a-49676ae9b7f5 time_started = 2024-12-21 07:57:25.194715 UTC
111362024-12-21T07:57:25.681ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 674.183584ms iteration = 3 status = {"collection_id":"92b5af3f-85df-41b1-be5a-49676ae9b7f5","time_done":"2024-12-21 07:57:25.504741 UTC","time_started":"2024-12-21 07:57:25.194715 UTC"}
111372024-12-21T07:57:25.681ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
111382024-12-21T07:57:25.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111392024-12-21T07:57:25.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111402024-12-21T07:57:25.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111412024-12-21T07:57:25.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111422024-12-21T07:57:25.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111432024-12-21T07:57:25.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111442024-12-21T07:57:25.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111452024-12-21T07:57:25.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111462024-12-21T07:57:25.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-12-21T07:57:25.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111482024-12-21T07:57:25.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111492024-12-21T07:57:25.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111502024-12-21T07:57:25.756ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.960185ms iteration = 24 status = {"physical_disks_added":0}
111512024-12-21T07:57:25.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 498 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 8e077307-6b2a-446a-b1ba-ea37281c33f4 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
111522024-12-21T07:57:26.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea84de16-7518-4bfb-bcae-e07fd5173017 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111532024-12-21T07:57:26.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea84de16-7518-4bfb-bcae-e07fd5173017 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111542024-12-21T07:57:26.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea84de16-7518-4bfb-bcae-e07fd5173017 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111552024-12-21T07:57:27.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57b5420d-6da1-4e5e-9ba8-2d6d4bb65052 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111562024-12-21T07:57:27.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57b5420d-6da1-4e5e-9ba8-2d6d4bb65052 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111572024-12-21T07:57:27.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 57b5420d-6da1-4e5e-9ba8-2d6d4bb65052 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111582024-12-21T07:57:28.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0a164de-aa62-44a4-85e9-de92fb363a0d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111592024-12-21T07:57:28.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0a164de-aa62-44a4-85e9-de92fb363a0d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111602024-12-21T07:57:28.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0a164de-aa62-44a4-85e9-de92fb363a0d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111612024-12-21T07:57:29.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0413e64a-7a73-4fad-8162-77adce5efca1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111622024-12-21T07:57:29.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0413e64a-7a73-4fad-8162-77adce5efca1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111632024-12-21T07:57:29.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0413e64a-7a73-4fad-8162-77adce5efca1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111642024-12-21T07:57:30.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed97e78c-78b1-479a-9060-4513f6d9e296 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111652024-12-21T07:57:30.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed97e78c-78b1-479a-9060-4513f6d9e296 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111662024-12-21T07:57:30.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ed97e78c-78b1-479a-9060-4513f6d9e296 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111672024-12-21T07:57:31.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59d3843-1492-455b-974d-ce3d71a9b663 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111682024-12-21T07:57:31.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59d3843-1492-455b-974d-ce3d71a9b663 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111692024-12-21T07:57:31.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59d3843-1492-455b-974d-ce3d71a9b663 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111702024-12-21T07:57:32.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5286530a-9f68-495d-a8e4-4671f3559df0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111712024-12-21T07:57:32.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5286530a-9f68-495d-a8e4-4671f3559df0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111722024-12-21T07:57:32.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5286530a-9f68-495d-a8e4-4671f3559df0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111732024-12-21T07:57:33.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
111742024-12-21T07:57:33.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
111752024-12-21T07:57:33.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111762024-12-21T07:57:33.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111772024-12-21T07:57:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111782024-12-21T07:57:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111792024-12-21T07:57:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111802024-12-21T07:57:33.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111812024-12-21T07:57:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111822024-12-21T07:57:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111832024-12-21T07:57:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111842024-12-21T07:57:33.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.321934ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111852024-12-21T07:57:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111862024-12-21T07:57:33.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111872024-12-21T07:57:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111882024-12-21T07:57:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111892024-12-21T07:57:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
111902024-12-21T07:57:33.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111912024-12-21T07:57:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111922024-12-21T07:57:33.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
111932024-12-21T07:57:33.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.596303ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
111942024-12-21T07:57:33.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47ba6218-e252-4a81-bad6-a9ee186ed2a3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111952024-12-21T07:57:33.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47ba6218-e252-4a81-bad6-a9ee186ed2a3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111962024-12-21T07:57:33.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47ba6218-e252-4a81-bad6-a9ee186ed2a3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111972024-12-21T07:57:34.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c8223e-fd61-45db-ad53-6a4968391701 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111982024-12-21T07:57:34.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c8223e-fd61-45db-ad53-6a4968391701 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
111992024-12-21T07:57:34.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6c8223e-fd61-45db-ad53-6a4968391701 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112002024-12-21T07:57:35.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e8500eee-5d27-4d04-9e41-f05a927258dd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112012024-12-21T07:57:35.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e8500eee-5d27-4d04-9e41-f05a927258dd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112022024-12-21T07:57:35.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e8500eee-5d27-4d04-9e41-f05a927258dd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112032024-12-21T07:57:35.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 99f82b02-863f-4a3b-808b-7180a9fc3dc6 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
112042024-12-21T07:57:36.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a15ee09-1de1-4fb4-851e-a448f3062e88 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112052024-12-21T07:57:36.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a15ee09-1de1-4fb4-851e-a448f3062e88 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112062024-12-21T07:57:36.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1a15ee09-1de1-4fb4-851e-a448f3062e88 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112072024-12-21T07:57:37.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4961c824-6995-4850-90d5-954125394680 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112082024-12-21T07:57:37.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4961c824-6995-4850-90d5-954125394680 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112092024-12-21T07:57:37.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4961c824-6995-4850-90d5-954125394680 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112102024-12-21T07:57:38.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 24c7f62f-50b9-46d6-8e34-d712fe10adea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112112024-12-21T07:57:38.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 24c7f62f-50b9-46d6-8e34-d712fe10adea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112122024-12-21T07:57:38.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 24c7f62f-50b9-46d6-8e34-d712fe10adea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112132024-12-21T07:57:39.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b165596b-319a-4b93-87cf-3598326bd83c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112142024-12-21T07:57:39.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b165596b-319a-4b93-87cf-3598326bd83c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112152024-12-21T07:57:39.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b165596b-319a-4b93-87cf-3598326bd83c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112162024-12-21T07:57:40.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bedde4af-b2ec-494b-a438-67f3f0276d16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112172024-12-21T07:57:40.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bedde4af-b2ec-494b-a438-67f3f0276d16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112182024-12-21T07:57:40.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bedde4af-b2ec-494b-a438-67f3f0276d16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112192024-12-21T07:57:41.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77248bd9-80da-4810-856a-4859d655d689 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112202024-12-21T07:57:41.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77248bd9-80da-4810-856a-4859d655d689 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112212024-12-21T07:57:41.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 77248bd9-80da-4810-856a-4859d655d689 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112222024-12-21T07:57:42.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a239f83-4ca3-46e4-91a7-263e3c9b9c48 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112232024-12-21T07:57:42.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a239f83-4ca3-46e4-91a7-263e3c9b9c48 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112242024-12-21T07:57:42.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a239f83-4ca3-46e4-91a7-263e3c9b9c48 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112252024-12-21T07:57:43.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
112262024-12-21T07:57:43.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
112272024-12-21T07:57:43.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112282024-12-21T07:57:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112292024-12-21T07:57:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112302024-12-21T07:57:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112312024-12-21T07:57:43.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112322024-12-21T07:57:43.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112332024-12-21T07:57:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112342024-12-21T07:57:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112352024-12-21T07:57:43.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112362024-12-21T07:57:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112372024-12-21T07:57:43.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112382024-12-21T07:57:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112392024-12-21T07:57:43.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112402024-12-21T07:57:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
112412024-12-21T07:57:43.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112422024-12-21T07:57:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112432024-12-21T07:57:43.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
112442024-12-21T07:57:43.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.07738ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
112452024-12-21T07:57:43.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.868892ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112462024-12-21T07:57:44.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e63c4b80-682a-4ed1-8d05-c6592d1ce7f3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112472024-12-21T07:57:44.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e63c4b80-682a-4ed1-8d05-c6592d1ce7f3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112482024-12-21T07:57:44.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e63c4b80-682a-4ed1-8d05-c6592d1ce7f3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112492024-12-21T07:57:45.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a518d1f-b7c0-4022-8046-46ef47ef800a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112502024-12-21T07:57:45.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a518d1f-b7c0-4022-8046-46ef47ef800a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112512024-12-21T07:57:45.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7a518d1f-b7c0-4022-8046-46ef47ef800a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112522024-12-21T07:57:45.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 539 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 36e7b680-25ae-4995-a682-9c69c9b35037 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
112532024-12-21T07:57:46.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e8669c9-66d5-4fa8-bd32-8b7406b4f1d5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112542024-12-21T07:57:46.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e8669c9-66d5-4fa8-bd32-8b7406b4f1d5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112552024-12-21T07:57:46.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0e8669c9-66d5-4fa8-bd32-8b7406b4f1d5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112562024-12-21T07:57:47.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 43087ffd-760f-4845-84e1-614248677348 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112572024-12-21T07:57:47.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 43087ffd-760f-4845-84e1-614248677348 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112582024-12-21T07:57:47.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 43087ffd-760f-4845-84e1-614248677348 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112592024-12-21T07:57:48.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 194a3de7-c32f-4ca8-8f01-4aeeb99e96ac roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112602024-12-21T07:57:48.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 194a3de7-c32f-4ca8-8f01-4aeeb99e96ac resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112612024-12-21T07:57:48.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 194a3de7-c32f-4ca8-8f01-4aeeb99e96ac response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112622024-12-21T07:57:49.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59b6e63-b905-4036-8356-4f35094a070d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112632024-12-21T07:57:49.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59b6e63-b905-4036-8356-4f35094a070d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112642024-12-21T07:57:49.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d59b6e63-b905-4036-8356-4f35094a070d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112652024-12-21T07:57:50.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15182e6-d44c-460a-9361-a6890538116a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112662024-12-21T07:57:50.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15182e6-d44c-460a-9361-a6890538116a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112672024-12-21T07:57:50.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a15182e6-d44c-460a-9361-a6890538116a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112682024-12-21T07:57:51.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f26e76f1-0bd7-4562-b59f-42b25c39007a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112692024-12-21T07:57:51.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f26e76f1-0bd7-4562-b59f-42b25c39007a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112702024-12-21T07:57:51.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f26e76f1-0bd7-4562-b59f-42b25c39007a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112712024-12-21T07:57:52.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 67eaa9dd-0b54-4ecd-8d3c-2035ef1b259c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112722024-12-21T07:57:52.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 67eaa9dd-0b54-4ecd-8d3c-2035ef1b259c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112732024-12-21T07:57:52.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 67eaa9dd-0b54-4ecd-8d3c-2035ef1b259c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112742024-12-21T07:57:53.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c588049-7383-4c41-8818-fc7009e0cb84 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112752024-12-21T07:57:53.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c588049-7383-4c41-8818-fc7009e0cb84 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112762024-12-21T07:57:53.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c588049-7383-4c41-8818-fc7009e0cb84 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
112772024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
112782024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
112792024-12-21T07:57:53.583ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112802024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112812024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112822024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
112832024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
112842024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
112852024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112862024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112872024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112882024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
112892024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
112902024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
112912024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
112922024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112932024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112942024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
112952024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112962024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112972024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112982024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
112992024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113002024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
113012024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113022024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
113032024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113042024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
113052024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113062024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
113072024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113082024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
113092024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113102024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
113112024-12-21T07:57:53.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113122024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113132024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113142024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113152024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113162024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113172024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113182024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113192024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113202024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
113212024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113222024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113232024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113242024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113252024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113262024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113272024-12-21T07:57:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113282024-12-21T07:57:53.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113292024-12-21T07:57:53.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113302024-12-21T07:57:53.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113312024-12-21T07:57:53.587ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.275534ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113322024-12-21T07:57:53.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113332024-12-21T07:57:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113342024-12-21T07:57:53.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113352024-12-21T07:57:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113362024-12-21T07:57:53.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113372024-12-21T07:57:53.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113382024-12-21T07:57:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113392024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113402024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113412024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113422024-12-21T07:57:53.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 539083690 } })
113432024-12-21T07:57:53.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
113442024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113452024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113462024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113472024-12-21T07:57:53.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 542009040 } })
113482024-12-21T07:57:53.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
113492024-12-21T07:57:53.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113502024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
113512024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113522024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113532024-12-21T07:57:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113542024-12-21T07:57:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113552024-12-21T07:57:53.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113562024-12-21T07:57:53.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113572024-12-21T07:57:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113582024-12-21T07:57:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113592024-12-21T07:57:53.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113602024-12-21T07:57:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113612024-12-21T07:57:53.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113622024-12-21T07:57:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113632024-12-21T07:57:53.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113642024-12-21T07:57:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113652024-12-21T07:57:53.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113662024-12-21T07:57:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113672024-12-21T07:57:53.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113682024-12-21T07:57:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113692024-12-21T07:57:53.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113702024-12-21T07:57:53.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.073853ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
113712024-12-21T07:57:53.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113722024-12-21T07:57:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113732024-12-21T07:57:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113742024-12-21T07:57:53.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752024-12-21T07:57:53.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.119881ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
113762024-12-21T07:57:53.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113772024-12-21T07:57:53.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113782024-12-21T07:57:53.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113792024-12-21T07:57:53.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113802024-12-21T07:57:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
113812024-12-21T07:57:53.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113822024-12-21T07:57:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.129155ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113832024-12-21T07:57:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113842024-12-21T07:57:53.657ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 603960442 } })
113852024-12-21T07:57:53.657ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
113862024-12-21T07:57:53.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113872024-12-21T07:57:53.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113882024-12-21T07:57:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113892024-12-21T07:57:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113902024-12-21T07:57:53.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113912024-12-21T07:57:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113922024-12-21T07:57:53.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113932024-12-21T07:57:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113942024-12-21T07:57:53.665ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113952024-12-21T07:57:53.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.705571ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113962024-12-21T07:57:53.667ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113972024-12-21T07:57:53.668ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113982024-12-21T07:57:53.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113992024-12-21T07:57:53.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114002024-12-21T07:57:53.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114012024-12-21T07:57:53.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114022024-12-21T07:57:53.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114032024-12-21T07:57:53.679ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114042024-12-21T07:57:53.679ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f59fe6a6-501f-472a-9c2a-339cd29b8c55", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114052024-12-21T07:57:53.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114062024-12-21T07:57:53.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114072024-12-21T07:57:53.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.194807ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114082024-12-21T07:57:53.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114092024-12-21T07:57:53.689ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114102024-12-21T07:57:53.689ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d56451c9-7621-43d9-8e29-3b6820a47fa3", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114112024-12-21T07:57:53.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114122024-12-21T07:57:53.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114132024-12-21T07:57:53.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114142024-12-21T07:57:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114152024-12-21T07:57:53.754ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114162024-12-21T07:57:53.754ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114172024-12-21T07:57:53.754ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7242385a-cf33-48a8-8b18-be030be7aa7f", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114182024-12-21T07:57:53.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114192024-12-21T07:57:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114202024-12-21T07:57:53.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114212024-12-21T07:57:53.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114222024-12-21T07:57:53.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
114232024-12-21T07:57:53.763ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114242024-12-21T07:57:53.763ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0924af30-144a-48e8-b341-ac7164580faa", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114252024-12-21T07:57:53.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114262024-12-21T07:57:53.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
114272024-12-21T07:57:53.772ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
114282024-12-21T07:57:53.772ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 189.168114ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
114292024-12-21T07:57:53.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114302024-12-21T07:57:53.804ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114312024-12-21T07:57:53.804ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
114322024-12-21T07:57:53.804ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 220.581353ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
114332024-12-21T07:57:53.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 222.896783ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114342024-12-21T07:57:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
114352024-12-21T07:57:53.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114362024-12-21T07:57:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114372024-12-21T07:57:53.810ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 227.39825ms iteration = 22 status = 0
114382024-12-21T07:57:53.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 231.037812ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
114392024-12-21T07:57:53.823ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
114402024-12-21T07:57:53.823ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114412024-12-21T07:57:53.865ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 281.619909ms iteration = 25 status = {"physical_disks_added":0}
114422024-12-21T07:57:53.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114432024-12-21T07:57:53.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114442024-12-21T07:57:53.882ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.405388ms iteration = 22 status = {}
114452024-12-21T07:57:53.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
114462024-12-21T07:57:53.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "99c5381a-90fa-44a8-9d20-4d30538c4066", "content-length": "1", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114472024-12-21T07:57:53.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114482024-12-21T07:57:53.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114492024-12-21T07:57:53.889ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.13806ms iteration = 22 status = null
114502024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5b0b258f-50fc-4358-b6e9-17e1a600f5d6", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114512024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114522024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114532024-12-21T07:57:53.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114542024-12-21T07:57:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114552024-12-21T07:57:53.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114562024-12-21T07:57:53.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114572024-12-21T07:57:53.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114582024-12-21T07:57:53.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114592024-12-21T07:57:53.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114602024-12-21T07:57:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114612024-12-21T07:57:53.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114622024-12-21T07:57:53.910ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114632024-12-21T07:57:53.910ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114642024-12-21T07:57:53.911ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7339bd82-06aa-4ea4-b169-a85907b4e2e1", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114652024-12-21T07:57:53.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114662024-12-21T07:57:53.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114672024-12-21T07:57:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114682024-12-21T07:57:53.912ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.88584ms iteration = 22 status = {}
114692024-12-21T07:57:53.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114702024-12-21T07:57:53.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114712024-12-21T07:57:53.941ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
114722024-12-21T07:57:53.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114732024-12-21T07:57:53.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114742024-12-21T07:57:53.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114752024-12-21T07:57:53.951ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a75433-9237-4d10-aacb-91a310112409", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114762024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114772024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
114782024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114792024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114802024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114812024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114822024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114832024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114842024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114852024-12-21T07:57:53.951ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114862024-12-21T07:57:53.952ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
114872024-12-21T07:57:53.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114882024-12-21T07:57:53.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114892024-12-21T07:57:53.953ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
114902024-12-21T07:57:53.953ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f402631-d0ed-45c8-8625-4e0ddac3a8ba", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114912024-12-21T07:57:53.953ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
114922024-12-21T07:57:53.953ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a364a48-4ce7-4695-b81d-77027674eb0a", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114932024-12-21T07:57:53.953ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
114942024-12-21T07:57:53.954ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
114952024-12-21T07:57:53.999ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114962024-12-21T07:57:53.999ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ffcffd6-9f87-47f7-a460-bf4f34beea00", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
114972024-12-21T07:57:53.999ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
114982024-12-21T07:57:53.999ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
114992024-12-21T07:57:53.999ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115002024-12-21T07:57:54.001ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.569081ms iteration = 22 status = {}
115012024-12-21T07:57:54.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c9104909-8642-455b-b8b5-b1d1607962cf", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
115022024-12-21T07:57:54.091ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
115032024-12-21T07:57:54.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115042024-12-21T07:57:54.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "07029017-bea9-4295-9a2f-79d816461cca", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
115052024-12-21T07:57:54.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115062024-12-21T07:57:54.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115072024-12-21T07:57:54.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115082024-12-21T07:57:54.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115092024-12-21T07:57:54.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115102024-12-21T07:57:54.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115112024-12-21T07:57:54.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115122024-12-21T07:57:54.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115132024-12-21T07:57:54.108ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.152258ms iteration = 22 status = {}
115142024-12-21T07:57:54.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7257515-40fc-4ef1-843d-36a275e7c059 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115152024-12-21T07:57:54.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7257515-40fc-4ef1-843d-36a275e7c059 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115162024-12-21T07:57:54.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7257515-40fc-4ef1-843d-36a275e7c059 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115172024-12-21T07:57:55.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d42da228-f58a-41d1-a011-80d823547e26 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115182024-12-21T07:57:55.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d42da228-f58a-41d1-a011-80d823547e26 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115192024-12-21T07:57:55.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d42da228-f58a-41d1-a011-80d823547e26 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115202024-12-21T07:57:55.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 843 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 27242198-7bb8-46f9-982d-322dc6d27259 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
115212024-12-21T07:57:56.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a92ce718-5b0d-4b66-b5f8-3ed26afb08ea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115222024-12-21T07:57:56.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a92ce718-5b0d-4b66-b5f8-3ed26afb08ea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115232024-12-21T07:57:56.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a92ce718-5b0d-4b66-b5f8-3ed26afb08ea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115242024-12-21T07:57:57.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5359b027-ef75-4441-9aa3-ce7b31fea3cb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115252024-12-21T07:57:57.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5359b027-ef75-4441-9aa3-ce7b31fea3cb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115262024-12-21T07:57:57.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5359b027-ef75-4441-9aa3-ce7b31fea3cb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115272024-12-21T07:57:58.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63c908d5-34d2-4e4b-9576-25560ec71b68 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115282024-12-21T07:57:58.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63c908d5-34d2-4e4b-9576-25560ec71b68 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115292024-12-21T07:57:58.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 63c908d5-34d2-4e4b-9576-25560ec71b68 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115302024-12-21T07:57:59.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 946f84ef-0f1a-4f59-a6fc-6871a9a9883d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115312024-12-21T07:57:59.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 946f84ef-0f1a-4f59-a6fc-6871a9a9883d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115322024-12-21T07:57:59.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 946f84ef-0f1a-4f59-a6fc-6871a9a9883d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115332024-12-21T07:58:00.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb039706-6458-4d8b-ba2f-f59cb22dc453 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115342024-12-21T07:58:00.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb039706-6458-4d8b-ba2f-f59cb22dc453 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115352024-12-21T07:58:00.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = bb039706-6458-4d8b-ba2f-f59cb22dc453 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115362024-12-21T07:58:01.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a238050-7a52-45c6-9a7d-99e9fc5fbe3e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115372024-12-21T07:58:01.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a238050-7a52-45c6-9a7d-99e9fc5fbe3e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115382024-12-21T07:58:01.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9a238050-7a52-45c6-9a7d-99e9fc5fbe3e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115392024-12-21T07:58:02.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 550e23e6-4ac5-4f8b-92cf-da13bc788978 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115402024-12-21T07:58:02.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 550e23e6-4ac5-4f8b-92cf-da13bc788978 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115412024-12-21T07:58:02.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 550e23e6-4ac5-4f8b-92cf-da13bc788978 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115422024-12-21T07:58:03.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 16b0e51c-6207-4da1-836f-96e97a81ec43 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115432024-12-21T07:58:03.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 16b0e51c-6207-4da1-836f-96e97a81ec43 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115442024-12-21T07:58:03.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 16b0e51c-6207-4da1-836f-96e97a81ec43 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115452024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
115462024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
115472024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115482024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115492024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115502024-12-21T07:58:03.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115512024-12-21T07:58:03.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115522024-12-21T07:58:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115532024-12-21T07:58:03.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115542024-12-21T07:58:03.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115552024-12-21T07:58:03.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115562024-12-21T07:58:03.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115572024-12-21T07:58:03.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115582024-12-21T07:58:03.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115592024-12-21T07:58:03.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115602024-12-21T07:58:03.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
115612024-12-21T07:58:03.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115622024-12-21T07:58:03.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115632024-12-21T07:58:03.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
115642024-12-21T07:58:03.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.354254ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
115652024-12-21T07:58:03.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.670575ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115662024-12-21T07:58:04.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b9fb640-c077-45dc-b8b6-ebecd86a5fc6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115672024-12-21T07:58:04.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b9fb640-c077-45dc-b8b6-ebecd86a5fc6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115682024-12-21T07:58:04.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3b9fb640-c077-45dc-b8b6-ebecd86a5fc6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115692024-12-21T07:58:05.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9180c66e-eb33-4fd8-be2b-c4eb0276a492 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115702024-12-21T07:58:05.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9180c66e-eb33-4fd8-be2b-c4eb0276a492 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115712024-12-21T07:58:05.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9180c66e-eb33-4fd8-be2b-c4eb0276a492 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115722024-12-21T07:58:05.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 821 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = ebc141ff-a1b8-4f6f-be68-5c3f7cb4a19e response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
115732024-12-21T07:58:06.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9be9576-8f63-4304-aa15-f3022c67f973 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115742024-12-21T07:58:06.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9be9576-8f63-4304-aa15-f3022c67f973 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115752024-12-21T07:58:06.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a9be9576-8f63-4304-aa15-f3022c67f973 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115762024-12-21T07:58:07.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae95b890-318d-40f2-9856-28d4a4e062f6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115772024-12-21T07:58:07.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae95b890-318d-40f2-9856-28d4a4e062f6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115782024-12-21T07:58:07.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ae95b890-318d-40f2-9856-28d4a4e062f6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115792024-12-21T07:58:08.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e94ea6df-f5dc-4de6-a421-ab37b9004dca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115802024-12-21T07:58:08.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e94ea6df-f5dc-4de6-a421-ab37b9004dca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115812024-12-21T07:58:08.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e94ea6df-f5dc-4de6-a421-ab37b9004dca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115822024-12-21T07:58:09.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd21900c-7d8b-4483-b2b7-8b036a5d9d29 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115832024-12-21T07:58:09.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd21900c-7d8b-4483-b2b7-8b036a5d9d29 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115842024-12-21T07:58:09.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd21900c-7d8b-4483-b2b7-8b036a5d9d29 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115852024-12-21T07:58:10.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be0d98e8-77a2-4488-b988-2b57c5aff000 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115862024-12-21T07:58:10.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be0d98e8-77a2-4488-b988-2b57c5aff000 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115872024-12-21T07:58:10.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = be0d98e8-77a2-4488-b988-2b57c5aff000 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115882024-12-21T07:58:11.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af3d93c0-c670-4a4b-98fe-9c81674ae707 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115892024-12-21T07:58:11.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af3d93c0-c670-4a4b-98fe-9c81674ae707 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115902024-12-21T07:58:11.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = af3d93c0-c670-4a4b-98fe-9c81674ae707 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115912024-12-21T07:58:12.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0f2de913-90cb-4553-8c88-250a796e9e2d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115922024-12-21T07:58:12.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0f2de913-90cb-4553-8c88-250a796e9e2d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115932024-12-21T07:58:12.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0f2de913-90cb-4553-8c88-250a796e9e2d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
115942024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
115952024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
115962024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115972024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115982024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115992024-12-21T07:58:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116002024-12-21T07:58:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116012024-12-21T07:58:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116022024-12-21T07:58:13.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116032024-12-21T07:58:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116042024-12-21T07:58:13.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116052024-12-21T07:58:13.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116062024-12-21T07:58:13.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116072024-12-21T07:58:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
116082024-12-21T07:58:13.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116092024-12-21T07:58:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116102024-12-21T07:58:13.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
116112024-12-21T07:58:13.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.98872ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
116122024-12-21T07:58:13.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116132024-12-21T07:58:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116142024-12-21T07:58:13.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.88318ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116152024-12-21T07:58:13.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07f3b4b3-2619-411f-ba10-65c496be2934 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116162024-12-21T07:58:13.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07f3b4b3-2619-411f-ba10-65c496be2934 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116172024-12-21T07:58:13.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 07f3b4b3-2619-411f-ba10-65c496be2934 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116182024-12-21T07:58:14.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3d25b41-689e-4d06-ab04-ac38ea63a7bb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116192024-12-21T07:58:14.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3d25b41-689e-4d06-ab04-ac38ea63a7bb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116202024-12-21T07:58:14.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3d25b41-689e-4d06-ab04-ac38ea63a7bb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116212024-12-21T07:58:15.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f697dec-a626-4dba-8c8a-769292fda5f3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116222024-12-21T07:58:15.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f697dec-a626-4dba-8c8a-769292fda5f3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116232024-12-21T07:58:15.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2f697dec-a626-4dba-8c8a-769292fda5f3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116242024-12-21T07:58:15.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 810 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 8c80bf40-4d2c-4ea6-96e9-1420726361d9 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
116252024-12-21T07:58:16.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b337f984-6faf-4ed1-9203-aae6554cc6d6 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116262024-12-21T07:58:16.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b337f984-6faf-4ed1-9203-aae6554cc6d6 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116272024-12-21T07:58:16.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b337f984-6faf-4ed1-9203-aae6554cc6d6 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116282024-12-21T07:58:17.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2543ba7-5b90-47ca-b84b-26d30fc4b5b2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116292024-12-21T07:58:17.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2543ba7-5b90-47ca-b84b-26d30fc4b5b2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116302024-12-21T07:58:17.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d2543ba7-5b90-47ca-b84b-26d30fc4b5b2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116312024-12-21T07:58:18.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a8a29f-0e93-438b-90c9-b698c784eb25 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116322024-12-21T07:58:18.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a8a29f-0e93-438b-90c9-b698c784eb25 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116332024-12-21T07:58:18.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 89a8a29f-0e93-438b-90c9-b698c784eb25 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116342024-12-21T07:58:19.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3eee7c6-acc0-401f-8a5a-b5ac5fdd132e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116352024-12-21T07:58:19.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3eee7c6-acc0-401f-8a5a-b5ac5fdd132e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116362024-12-21T07:58:19.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b3eee7c6-acc0-401f-8a5a-b5ac5fdd132e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116372024-12-21T07:58:20.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0efb0d4-206d-4e3d-bfc1-8a468368371f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116382024-12-21T07:58:20.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0efb0d4-206d-4e3d-bfc1-8a468368371f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116392024-12-21T07:58:20.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0efb0d4-206d-4e3d-bfc1-8a468368371f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116402024-12-21T07:58:20.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 69866e1c-dbfe-4e7d-961e-f093757119f6 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
116412024-12-21T07:58:20.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 69866e1c-dbfe-4e7d-961e-f093757119f6 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
116422024-12-21T07:58:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 69866e1c-dbfe-4e7d-961e-f093757119f6 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
116432024-12-21T07:58:20.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7dc1d526-f7cd-4c2d-8dec-15349e16210b roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
116442024-12-21T07:58:20.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7dc1d526-f7cd-4c2d-8dec-15349e16210b resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
116452024-12-21T07:58:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 7dc1d526-f7cd-4c2d-8dec-15349e16210b response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
116462024-12-21T07:58:21.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 22b0f746-97cc-405a-a435-3b7ecebc82cb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116472024-12-21T07:58:21.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 22b0f746-97cc-405a-a435-3b7ecebc82cb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116482024-12-21T07:58:21.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 22b0f746-97cc-405a-a435-3b7ecebc82cb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116492024-12-21T07:58:22.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1eab13bb-7b0b-43ff-a7a8-d88bbd69bfde roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116502024-12-21T07:58:22.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1eab13bb-7b0b-43ff-a7a8-d88bbd69bfde resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116512024-12-21T07:58:22.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1eab13bb-7b0b-43ff-a7a8-d88bbd69bfde response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
116522024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
116532024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
116542024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116552024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
116562024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116572024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
116582024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116592024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
116602024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
116612024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116622024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116632024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
116642024-12-21T07:58:23.584ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
116652024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
116662024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116672024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
116682024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
116692024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116702024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116712024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
116722024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
116732024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
116742024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
116752024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
116762024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
116772024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116782024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
116792024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116802024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
116812024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116822024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
116832024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
116842024-12-21T07:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116852024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
116862024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
116872024-12-21T07:58:23.585ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
116882024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
116892024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.361\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
116902024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116912024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
116922024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
116932024-12-21T07:58:23.585ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:48:23.584885036 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
116942024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
116952024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
116962024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116972024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
116982024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
116992024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
117002024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
117012024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117022024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
117032024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
117042024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117052024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117062024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
117072024-12-21T07:58:23.585ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117082024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117092024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
117102024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117112024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
117122024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117132024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
117142024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117152024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117162024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117172024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117182024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117192024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
117202024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117212024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
117222024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117232024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117242024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117252024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117262024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117272024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117282024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117292024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
117302024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117312024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117322024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
117332024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117342024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
117352024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117362024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117372024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117382024-12-21T07:58:23.585ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 532155361 } })
117392024-12-21T07:58:23.585ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 532162761 } })
117402024-12-21T07:58:23.586ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
117412024-12-21T07:58:23.586ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
117422024-12-21T07:58:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.567907ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
117432024-12-21T07:58:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.692499ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
117442024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117452024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117462024-12-21T07:58:23.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117472024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117482024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117492024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117502024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.677178ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117512024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117522024-12-21T07:58:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117532024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117542024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117552024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117562024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117572024-12-21T07:58:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117582024-12-21T07:58:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117592024-12-21T07:58:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.171322ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
117602024-12-21T07:58:23.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117612024-12-21T07:58:23.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117622024-12-21T07:58:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117632024-12-21T07:58:23.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 545583201 } })
117642024-12-21T07:58:23.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
117652024-12-21T07:58:23.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117662024-12-21T07:58:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
117672024-12-21T07:58:23.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117682024-12-21T07:58:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117692024-12-21T07:58:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117702024-12-21T07:58:23.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117712024-12-21T07:58:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117722024-12-21T07:58:23.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:48:23.584885036 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
117732024-12-21T07:58:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.886173ms iteration = 12 status = {"expiration":"2024-12-21T07:48:23.584885036Z","pruned":[]}
117742024-12-21T07:58:23.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117752024-12-21T07:58:23.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.248366ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
117762024-12-21T07:58:23.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117772024-12-21T07:58:23.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117782024-12-21T07:58:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117792024-12-21T07:58:23.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117802024-12-21T07:58:23.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 575546765 } })
117812024-12-21T07:58:23.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
117822024-12-21T07:58:23.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117832024-12-21T07:58:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117842024-12-21T07:58:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117852024-12-21T07:58:23.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117862024-12-21T07:58:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117872024-12-21T07:58:23.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117882024-12-21T07:58:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117892024-12-21T07:58:23.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117902024-12-21T07:58:23.657ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117912024-12-21T07:58:23.657ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117922024-12-21T07:58:23.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117932024-12-21T07:58:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117942024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
117952024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117962024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117972024-12-21T07:58:23.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117982024-12-21T07:58:23.662ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117992024-12-21T07:58:23.662ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118002024-12-21T07:58:23.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118012024-12-21T07:58:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118022024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118032024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118042024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118052024-12-21T07:58:23.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118062024-12-21T07:58:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118072024-12-21T07:58:23.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118082024-12-21T07:58:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118092024-12-21T07:58:23.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118102024-12-21T07:58:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.19429ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
118112024-12-21T07:58:23.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118122024-12-21T07:58:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118132024-12-21T07:58:23.675ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
118142024-12-21T07:58:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.128983ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
118152024-12-21T07:58:23.675ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
118162024-12-21T07:58:23.675ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
118172024-12-21T07:58:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.781528ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
118182024-12-21T07:58:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118192024-12-21T07:58:23.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118202024-12-21T07:58:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118212024-12-21T07:58:23.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 631315322 } })
118222024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118232024-12-21T07:58:23.685ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
118242024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
118252024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
118262024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
118272024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118282024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118292024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118302024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118312024-12-21T07:58:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118322024-12-21T07:58:23.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118332024-12-21T07:58:23.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118342024-12-21T07:58:23.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118352024-12-21T07:58:23.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118362024-12-21T07:58:23.696ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118372024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118382024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118392024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118402024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118412024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118422024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118432024-12-21T07:58:23.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118442024-12-21T07:58:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118452024-12-21T07:58:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118462024-12-21T07:58:23.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118472024-12-21T07:58:23.699ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118482024-12-21T07:58:23.699ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.084134ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118492024-12-21T07:58:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118502024-12-21T07:58:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118512024-12-21T07:58:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.574963ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118522024-12-21T07:58:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
118532024-12-21T07:58:23.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118542024-12-21T07:58:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118552024-12-21T07:58:23.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
118562024-12-21T07:58:23.707ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
118572024-12-21T07:58:23.707ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
118582024-12-21T07:58:23.707ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.496851ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
118592024-12-21T07:58:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118602024-12-21T07:58:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.497136ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118612024-12-21T07:58:23.717ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118622024-12-21T07:58:23.717ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118632024-12-21T07:58:23.717ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.153814ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118642024-12-21T07:58:23.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118652024-12-21T07:58:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118662024-12-21T07:58:23.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.232843ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118672024-12-21T07:58:23.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118682024-12-21T07:58:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118692024-12-21T07:58:23.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118702024-12-21T07:58:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
118712024-12-21T07:58:23.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118722024-12-21T07:58:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118732024-12-21T07:58:23.738ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 153.385551ms iteration = 23 status = 0
118742024-12-21T07:58:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.213002ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
118752024-12-21T07:58:23.744ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
118762024-12-21T07:58:23.744ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
118772024-12-21T07:58:23.744ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
118782024-12-21T07:58:23.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118792024-12-21T07:58:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118802024-12-21T07:58:23.745ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
118812024-12-21T07:58:23.745ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
118822024-12-21T07:58:23.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118832024-12-21T07:58:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118842024-12-21T07:58:23.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118852024-12-21T07:58:23.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118862024-12-21T07:58:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118872024-12-21T07:58:23.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118882024-12-21T07:58:23.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118892024-12-21T07:58:23.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118902024-12-21T07:58:23.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118912024-12-21T07:58:23.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118922024-12-21T07:58:23.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118932024-12-21T07:58:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118942024-12-21T07:58:23.754ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
118952024-12-21T07:58:23.754ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
118962024-12-21T07:58:23.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118972024-12-21T07:58:23.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118982024-12-21T07:58:23.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118992024-12-21T07:58:23.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119002024-12-21T07:58:23.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119012024-12-21T07:58:23.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119022024-12-21T07:58:23.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
119032024-12-21T07:58:23.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
119042024-12-21T07:58:23.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
119052024-12-21T07:58:23.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 179.931367ms iteration = 12 status = {"generation":1}
119062024-12-21T07:58:23.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119072024-12-21T07:58:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119082024-12-21T07:58:23.773ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119092024-12-21T07:58:23.773ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119102024-12-21T07:58:23.774ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b61528c1-c2c8-4e0e-83ea-b8a7da23d906", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119112024-12-21T07:58:23.774ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119122024-12-21T07:58:23.776ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119132024-12-21T07:58:23.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119142024-12-21T07:58:23.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119152024-12-21T07:58:23.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119162024-12-21T07:58:23.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119172024-12-21T07:58:23.786ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
119182024-12-21T07:58:23.786ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
119192024-12-21T07:58:23.786ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
119202024-12-21T07:58:23.786ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 201.866303ms iteration = 12 status = {"generation":2}
119212024-12-21T07:58:23.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
119222024-12-21T07:58:23.802ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
119232024-12-21T07:58:23.802ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 217.788855ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
119242024-12-21T07:58:23.827ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
119252024-12-21T07:58:23.827ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 242.459188ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
119262024-12-21T07:58:23.845ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 260.809343ms iteration = 26 status = {"physical_disks_added":0}
119272024-12-21T07:58:23.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f78f2364-5eb4-4691-8da0-ebc064c13773 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
119282024-12-21T07:58:23.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f78f2364-5eb4-4691-8da0-ebc064c13773 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
119292024-12-21T07:58:23.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f78f2364-5eb4-4691-8da0-ebc064c13773 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
119302024-12-21T07:58:23.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119312024-12-21T07:58:23.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119322024-12-21T07:58:23.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119332024-12-21T07:58:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119342024-12-21T07:58:23.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119352024-12-21T07:58:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119362024-12-21T07:58:23.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119372024-12-21T07:58:23.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119382024-12-21T07:58:23.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119392024-12-21T07:58:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119402024-12-21T07:58:23.911ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119412024-12-21T07:58:23.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119422024-12-21T07:58:23.962ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119432024-12-21T07:58:23.963ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a051608-dae7-407c-bbce-4d22923d5503", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119442024-12-21T07:58:23.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119452024-12-21T07:58:23.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119462024-12-21T07:58:23.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
119472024-12-21T07:58:23.998ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119482024-12-21T07:58:23.998ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cc46ce3-761a-405a-8ca9-14544ec3aac7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119492024-12-21T07:58:23.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119502024-12-21T07:58:23.999ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
119512024-12-21T07:58:24.027ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119522024-12-21T07:58:24.027ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119532024-12-21T07:58:24.071ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c4fe016-0ac6-41d3-880c-2bcdc8703ed8", "content-length": "372", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119542024-12-21T07:58:24.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119552024-12-21T07:58:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119562024-12-21T07:58:24.115ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
119572024-12-21T07:58:24.115ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119582024-12-21T07:58:24.122ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119592024-12-21T07:58:24.159ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119602024-12-21T07:58:24.159ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a2a0325-d3a0-4434-9b2b-b4d68d3c0e6c", "content-length": "1", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
119612024-12-21T07:58:24.160ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 575.834207ms iteration = 23 status = {}
119622024-12-21T07:58:24.161ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119632024-12-21T07:58:24.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
119642024-12-21T07:58:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119652024-12-21T07:58:24.161ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ceb12cfc-3270-4860-91b4-9f801ad2d154", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119662024-12-21T07:58:24.161ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119672024-12-21T07:58:24.163ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1f70a34e-70c1-4e81-944e-44c968e358b9", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119682024-12-21T07:58:24.163ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119692024-12-21T07:58:24.163ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 578.802917ms iteration = 23 status = null
119702024-12-21T07:58:24.165ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119712024-12-21T07:58:24.165ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 580.492946ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
119722024-12-21T07:58:24.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
119732024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a1412def-2e42-48be-bcc3-7f3dc9ad29b2", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119742024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119752024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119762024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e47925cb-937a-473d-8d4e-55eef6b1a1a1", "content-length": "691", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
119772024-12-21T07:58:24.203ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119782024-12-21T07:58:24.203ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119792024-12-21T07:58:24.203ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119802024-12-21T07:58:24.205ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 620.729806ms iteration = 23 status = {}
119812024-12-21T07:58:24.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119822024-12-21T07:58:24.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119832024-12-21T07:58:24.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119842024-12-21T07:58:24.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
119852024-12-21T07:58:24.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119862024-12-21T07:58:24.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "10cd0373-d42b-4443-b454-1bcf33d144b4", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119872024-12-21T07:58:24.210ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119882024-12-21T07:58:24.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e0160992-fce9-4b0e-afb3-18bdcdfd127a", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119892024-12-21T07:58:24.212ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119902024-12-21T07:58:24.213ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119912024-12-21T07:58:24.213ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119922024-12-21T07:58:24.213ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "beff84e3-1e04-43e3-9af5-67a2e9f9e027", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
119932024-12-21T07:58:24.214ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f508569f-8512-421d-86e8-38ca14ab1624", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119942024-12-21T07:58:24.214ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119952024-12-21T07:58:24.215ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 630.336032ms iteration = 23 status = {}
119962024-12-21T07:58:24.216ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
119972024-12-21T07:58:24.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 631.891958ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
119982024-12-21T07:58:24.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119992024-12-21T07:58:24.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120002024-12-21T07:58:24.250ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
120012024-12-21T07:58:24.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120022024-12-21T07:58:24.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120032024-12-21T07:58:24.259ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120042024-12-21T07:58:24.260ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e904e549-9b15-4909-a004-faef76fe435f", "content-length": "134", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
120052024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120062024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
120072024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120082024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120092024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120102024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120112024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120122024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120132024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120142024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120152024-12-21T07:58:24.260ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
120162024-12-21T07:58:24.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120172024-12-21T07:58:24.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120182024-12-21T07:58:24.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120192024-12-21T07:58:24.263ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4fbdc0a-00fe-441f-afd7-723fc4656f38", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
120202024-12-21T07:58:24.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120212024-12-21T07:58:24.263ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dbc438b-843b-44da-a209-72b9810f01c6", "content-length": "52", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
120222024-12-21T07:58:24.263ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
120232024-12-21T07:58:24.263ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120242024-12-21T07:58:24.329ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
120252024-12-21T07:58:24.329ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
120262024-12-21T07:58:24.360ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
120272024-12-21T07:58:24.360ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37988
120282024-12-21T07:58:24.360ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f8531297-404d-4029-a0e8-7735b0e57338", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120292024-12-21T07:58:24.360ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
120302024-12-21T07:58:24.360ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
120312024-12-21T07:58:24.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37988 req_id = 470f7051-8427-4c31-9ddb-f68c81ddc9fb roles = RoleSet { roles: {} } uri = /metrics/producers
120322024-12-21T07:58:24.361ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "15e184da-6164-40a5-9f9e-4dc7c7ef6c13", "content-length": "682", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120332024-12-21T07:58:24.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120342024-12-21T07:58:24.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37988 req_id = 470f7051-8427-4c31-9ddb-f68c81ddc9fb resource = Database result = Ok(()) uri = /metrics/producers
120352024-12-21T07:58:24.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120362024-12-21T07:58:24.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120372024-12-21T07:58:24.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120382024-12-21T07:58:24.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120392024-12-21T07:58:24.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120402024-12-21T07:58:24.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120412024-12-21T07:58:24.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120422024-12-21T07:58:24.378ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 793.906388ms iteration = 23 status = {}
120432024-12-21T07:58:24.394ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 4b205886-0970-4a9e-bff0-ae1192504434
120442024-12-21T07:58:24.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33615 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37988 req_id = 470f7051-8427-4c31-9ddb-f68c81ddc9fb response_code = 201 uri = /metrics/producers
120452024-12-21T07:58:24.394ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "470f7051-8427-4c31-9ddb-f68c81ddc9fb", "content-length": "41", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120462024-12-21T07:58:24.396ZDEBGnexus (producer-registration-task): registered with nexus successfully
120472024-12-21T07:58:24.396ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
120482024-12-21T07:58:24.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e15b9545-8a8b-4ff7-8b9b-6f9659ad6503 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120492024-12-21T07:58:24.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e15b9545-8a8b-4ff7-8b9b-6f9659ad6503 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120502024-12-21T07:58:24.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e15b9545-8a8b-4ff7-8b9b-6f9659ad6503 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120512024-12-21T07:58:25.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = dbeee990-2127-47d6-9ed3-33c32709dd51 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
120522024-12-21T07:58:25.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3be629d3-d509-47e0-a1a0-37999916fcef roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120532024-12-21T07:58:25.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3be629d3-d509-47e0-a1a0-37999916fcef resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120542024-12-21T07:58:25.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3be629d3-d509-47e0-a1a0-37999916fcef response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120552024-12-21T07:58:26.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 96b25b2c-efc7-4b23-a820-abcb995bf0ee roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120562024-12-21T07:58:26.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 96b25b2c-efc7-4b23-a820-abcb995bf0ee resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120572024-12-21T07:58:26.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 96b25b2c-efc7-4b23-a820-abcb995bf0ee response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120582024-12-21T07:58:27.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7b6efd9-846e-4a18-8407-1584044125d0 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120592024-12-21T07:58:27.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7b6efd9-846e-4a18-8407-1584044125d0 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120602024-12-21T07:58:27.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b7b6efd9-846e-4a18-8407-1584044125d0 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120612024-12-21T07:58:28.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1898f93f-5aaa-4ef5-8bb5-ad32756535aa roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120622024-12-21T07:58:28.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1898f93f-5aaa-4ef5-8bb5-ad32756535aa resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120632024-12-21T07:58:28.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1898f93f-5aaa-4ef5-8bb5-ad32756535aa response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120642024-12-21T07:58:30.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6371363-ea5c-4d94-a35a-f0bc8d33b4c9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120652024-12-21T07:58:30.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6371363-ea5c-4d94-a35a-f0bc8d33b4c9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120662024-12-21T07:58:30.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6371363-ea5c-4d94-a35a-f0bc8d33b4c9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120672024-12-21T07:58:31.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35684edb-a073-4c11-804f-98b0c57e4ee7 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120682024-12-21T07:58:31.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35684edb-a073-4c11-804f-98b0c57e4ee7 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120692024-12-21T07:58:31.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35684edb-a073-4c11-804f-98b0c57e4ee7 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120702024-12-21T07:58:32.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 667bc9f8-1b0b-4c8d-acc1-7b2409eb514e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120712024-12-21T07:58:32.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 667bc9f8-1b0b-4c8d-acc1-7b2409eb514e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120722024-12-21T07:58:32.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 667bc9f8-1b0b-4c8d-acc1-7b2409eb514e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120732024-12-21T07:58:33.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b924a5d-0251-41b1-8ca4-3f331bc5328e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120742024-12-21T07:58:33.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b924a5d-0251-41b1-8ca4-3f331bc5328e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120752024-12-21T07:58:33.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9b924a5d-0251-41b1-8ca4-3f331bc5328e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120762024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
120772024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120782024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
120792024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120802024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120812024-12-21T07:58:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120822024-12-21T07:58:33.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120832024-12-21T07:58:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120842024-12-21T07:58:33.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.372695ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120852024-12-21T07:58:33.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120862024-12-21T07:58:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120872024-12-21T07:58:33.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120882024-12-21T07:58:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120892024-12-21T07:58:33.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120902024-12-21T07:58:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120912024-12-21T07:58:33.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120922024-12-21T07:58:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
120932024-12-21T07:58:33.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120942024-12-21T07:58:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120952024-12-21T07:58:33.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
120962024-12-21T07:58:33.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.029694ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
120972024-12-21T07:58:34.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6035950a-fd6e-4d06-9085-ad46ea388220 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120982024-12-21T07:58:34.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6035950a-fd6e-4d06-9085-ad46ea388220 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
120992024-12-21T07:58:34.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6035950a-fd6e-4d06-9085-ad46ea388220 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121002024-12-21T07:58:35.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b1e74758-4974-42b3-a524-e81ff3bce871 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121012024-12-21T07:58:35.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b1e74758-4974-42b3-a524-e81ff3bce871 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121022024-12-21T07:58:35.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b1e74758-4974-42b3-a524-e81ff3bce871 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121032024-12-21T07:58:35.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 9ac85c0e-33fd-45f1-b9f2-c609f47eff77 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
121042024-12-21T07:58:36.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0b62e2e-6ed1-4c54-ad75-6dbc7c7ebe58 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121052024-12-21T07:58:36.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0b62e2e-6ed1-4c54-ad75-6dbc7c7ebe58 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121062024-12-21T07:58:36.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d0b62e2e-6ed1-4c54-ad75-6dbc7c7ebe58 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121072024-12-21T07:58:37.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c25df0c-1b78-4bdf-b150-4d1df05db22f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121082024-12-21T07:58:37.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c25df0c-1b78-4bdf-b150-4d1df05db22f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121092024-12-21T07:58:37.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c25df0c-1b78-4bdf-b150-4d1df05db22f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121102024-12-21T07:58:38.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e7bd0a-d140-4b97-ab96-4ab824e0a441 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121112024-12-21T07:58:38.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e7bd0a-d140-4b97-ab96-4ab824e0a441 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121122024-12-21T07:58:38.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e7bd0a-d140-4b97-ab96-4ab824e0a441 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121132024-12-21T07:58:39.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36dfc200-5f44-4925-b423-340636a00551 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121142024-12-21T07:58:39.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36dfc200-5f44-4925-b423-340636a00551 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121152024-12-21T07:58:39.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36dfc200-5f44-4925-b423-340636a00551 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121162024-12-21T07:58:40.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d15ff2ae-d129-4076-b0c4-edc4bcd5378e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121172024-12-21T07:58:40.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d15ff2ae-d129-4076-b0c4-edc4bcd5378e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121182024-12-21T07:58:40.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d15ff2ae-d129-4076-b0c4-edc4bcd5378e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121192024-12-21T07:58:41.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb8fa6c-0528-4dc2-a097-a9983e88704e roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121202024-12-21T07:58:41.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb8fa6c-0528-4dc2-a097-a9983e88704e resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121212024-12-21T07:58:41.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5eb8fa6c-0528-4dc2-a097-a9983e88704e response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121222024-12-21T07:58:42.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea418da6-2483-4037-94cf-28afb9389201 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121232024-12-21T07:58:42.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea418da6-2483-4037-94cf-28afb9389201 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121242024-12-21T07:58:42.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ea418da6-2483-4037-94cf-28afb9389201 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121252024-12-21T07:58:43.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d984e531-4835-4404-a3d9-752e8624cdb2 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121262024-12-21T07:58:43.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d984e531-4835-4404-a3d9-752e8624cdb2 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121272024-12-21T07:58:43.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d984e531-4835-4404-a3d9-752e8624cdb2 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121282024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
121292024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
121302024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121312024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121322024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121332024-12-21T07:58:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121342024-12-21T07:58:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121352024-12-21T07:58:43.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121362024-12-21T07:58:43.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121372024-12-21T07:58:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121382024-12-21T07:58:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121392024-12-21T07:58:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121402024-12-21T07:58:43.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121412024-12-21T07:58:43.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121422024-12-21T07:58:43.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121432024-12-21T07:58:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
121442024-12-21T07:58:43.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121452024-12-21T07:58:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121462024-12-21T07:58:43.604ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
121472024-12-21T07:58:43.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.975643ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
121482024-12-21T07:58:43.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.928277ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121492024-12-21T07:58:44.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f41670ac-f1df-4e94-9fc7-8e54320e2807 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121502024-12-21T07:58:44.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f41670ac-f1df-4e94-9fc7-8e54320e2807 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121512024-12-21T07:58:44.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = f41670ac-f1df-4e94-9fc7-8e54320e2807 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121522024-12-21T07:58:45.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 975ba34a-6ff1-43a1-af02-bac0e911e9f5 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121532024-12-21T07:58:45.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 975ba34a-6ff1-43a1-af02-bac0e911e9f5 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121542024-12-21T07:58:45.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 975ba34a-6ff1-43a1-af02-bac0e911e9f5 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121552024-12-21T07:58:45.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = ef3d7a43-c448-4b87-9530-3559d0656a96 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
121562024-12-21T07:58:46.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e4d9da-1fd7-4aca-a51a-8ae5a3fedb16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121572024-12-21T07:58:46.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e4d9da-1fd7-4aca-a51a-8ae5a3fedb16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121582024-12-21T07:58:46.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 47e4d9da-1fd7-4aca-a51a-8ae5a3fedb16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121592024-12-21T07:58:47.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fdcc6f8-e652-4637-83f7-87fbe364effc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121602024-12-21T07:58:47.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fdcc6f8-e652-4637-83f7-87fbe364effc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121612024-12-21T07:58:47.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5fdcc6f8-e652-4637-83f7-87fbe364effc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121622024-12-21T07:58:48.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5158b145-2614-4751-b82a-c524c36dda4d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121632024-12-21T07:58:48.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5158b145-2614-4751-b82a-c524c36dda4d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121642024-12-21T07:58:48.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5158b145-2614-4751-b82a-c524c36dda4d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121652024-12-21T07:58:49.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbdccaeb-e057-4701-848e-d5fb71de5599 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121662024-12-21T07:58:49.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbdccaeb-e057-4701-848e-d5fb71de5599 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121672024-12-21T07:58:49.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbdccaeb-e057-4701-848e-d5fb71de5599 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121682024-12-21T07:58:50.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd887d8f-1293-408f-8460-0acb70de905c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121692024-12-21T07:58:50.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd887d8f-1293-408f-8460-0acb70de905c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121702024-12-21T07:58:50.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cd887d8f-1293-408f-8460-0acb70de905c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121712024-12-21T07:58:50.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 2b83ee90-9d1a-4579-ad05-ce914873a8cd roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
121722024-12-21T07:58:50.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 2b83ee90-9d1a-4579-ad05-ce914873a8cd resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
121732024-12-21T07:58:50.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 2b83ee90-9d1a-4579-ad05-ce914873a8cd response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
121742024-12-21T07:58:50.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 04d6df73-1fad-482f-a9cc-9e0c9459ec1d roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
121752024-12-21T07:58:50.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 04d6df73-1fad-482f-a9cc-9e0c9459ec1d resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
121762024-12-21T07:58:50.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 04d6df73-1fad-482f-a9cc-9e0c9459ec1d response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
121772024-12-21T07:58:51.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecee8040-474d-409e-95d4-dfde1b5018ca roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121782024-12-21T07:58:51.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecee8040-474d-409e-95d4-dfde1b5018ca resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121792024-12-21T07:58:51.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ecee8040-474d-409e-95d4-dfde1b5018ca response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121802024-12-21T07:58:52.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5467b53f-63bd-415e-b6be-e0963dd64e16 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121812024-12-21T07:58:52.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5467b53f-63bd-415e-b6be-e0963dd64e16 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121822024-12-21T07:58:52.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 5467b53f-63bd-415e-b6be-e0963dd64e16 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121832024-12-21T07:58:52.932ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55bcb422-7efa-43c9-a99c-1f947f03e4fa uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:58:52.922158013Z }
121842024-12-21T07:58:52.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55bcb422-7efa-43c9-a99c-1f947f03e4fa roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121852024-12-21T07:58:52.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55bcb422-7efa-43c9-a99c-1f947f03e4fa resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121862024-12-21T07:58:52.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57601 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 55bcb422-7efa-43c9-a99c-1f947f03e4fa response_code = 204 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121872024-12-21T07:58:52.980ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50bbe3e8-bf39-4488-807b-409f26dc5f7c uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }
121882024-12-21T07:58:52.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50bbe3e8-bf39-4488-807b-409f26dc5f7c roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121892024-12-21T07:58:52.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50bbe3e8-bf39-4488-807b-409f26dc5f7c resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121902024-12-21T07:58:53.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41856 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 50bbe3e8-bf39-4488-807b-409f26dc5f7c response_code = 204 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
121912024-12-21T07:58:53.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02146f9b-e7dd-4874-b47f-39b1a35df8e1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121922024-12-21T07:58:53.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02146f9b-e7dd-4874-b47f-39b1a35df8e1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121932024-12-21T07:58:53.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 02146f9b-e7dd-4874-b47f-39b1a35df8e1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
121942024-12-21T07:58:53.584ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
121952024-12-21T07:58:53.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121962024-12-21T07:58:53.584ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
121972024-12-21T07:58:53.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
121982024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
121992024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122002024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
122012024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122022024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122032024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
122042024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
122052024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122062024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
122072024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122082024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122092024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
122102024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122112024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122122024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
122132024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122142024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
122152024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
122162024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122172024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122182024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
122192024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122202024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
122212024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122222024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
122232024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122242024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
122252024-12-21T07:58:53.585ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122262024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122272024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
122282024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122292024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122302024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122312024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122322024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122332024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122342024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122352024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122362024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122372024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122382024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122392024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122402024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122412024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122422024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122432024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122442024-12-21T07:58:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122452024-12-21T07:58:53.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.706786ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
122462024-12-21T07:58:53.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122472024-12-21T07:58:53.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122482024-12-21T07:58:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122492024-12-21T07:58:53.589ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.10515ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122502024-12-21T07:58:53.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122512024-12-21T07:58:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122522024-12-21T07:58:53.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122532024-12-21T07:58:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122542024-12-21T07:58:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122552024-12-21T07:58:53.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122562024-12-21T07:58:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122572024-12-21T07:58:53.593ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122582024-12-21T07:58:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122592024-12-21T07:58:53.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122602024-12-21T07:58:53.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 542203073 } })
122612024-12-21T07:58:53.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
122622024-12-21T07:58:53.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122632024-12-21T07:58:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122642024-12-21T07:58:53.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122652024-12-21T07:58:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122662024-12-21T07:58:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122672024-12-21T07:58:53.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122682024-12-21T07:58:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122692024-12-21T07:58:53.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122702024-12-21T07:58:53.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122712024-12-21T07:58:53.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 548122115 } })
122722024-12-21T07:58:53.602ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
122732024-12-21T07:58:53.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122742024-12-21T07:58:53.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122752024-12-21T07:58:53.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122762024-12-21T07:58:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122772024-12-21T07:58:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122782024-12-21T07:58:53.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122792024-12-21T07:58:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122802024-12-21T07:58:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122812024-12-21T07:58:53.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122822024-12-21T07:58:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122832024-12-21T07:58:53.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122842024-12-21T07:58:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122852024-12-21T07:58:53.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 555224766 } })
122862024-12-21T07:58:53.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
122872024-12-21T07:58:53.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.398173ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
122882024-12-21T07:58:53.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122892024-12-21T07:58:53.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122902024-12-21T07:58:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122912024-12-21T07:58:53.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122922024-12-21T07:58:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122932024-12-21T07:58:53.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122942024-12-21T07:58:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122952024-12-21T07:58:53.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122962024-12-21T07:58:53.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122972024-12-21T07:58:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122982024-12-21T07:58:53.650ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122992024-12-21T07:58:53.650ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123002024-12-21T07:58:53.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123012024-12-21T07:58:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123022024-12-21T07:58:53.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123032024-12-21T07:58:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123042024-12-21T07:58:53.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.091011ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123052024-12-21T07:58:53.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123062024-12-21T07:58:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123072024-12-21T07:58:53.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123082024-12-21T07:58:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123092024-12-21T07:58:53.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123102024-12-21T07:58:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.244378ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123112024-12-21T07:58:53.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123122024-12-21T07:58:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
123132024-12-21T07:58:53.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123142024-12-21T07:58:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123152024-12-21T07:58:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123162024-12-21T07:58:53.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123172024-12-21T07:58:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123182024-12-21T07:58:53.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123192024-12-21T07:58:53.678ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123202024-12-21T07:58:53.678ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e410b60f-c3a6-4027-a3ed-90fcb3ed2795", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123212024-12-21T07:58:53.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123222024-12-21T07:58:53.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123232024-12-21T07:58:53.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
123242024-12-21T07:58:53.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.011634ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
123252024-12-21T07:58:53.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123262024-12-21T07:58:53.702ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123272024-12-21T07:58:53.702ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123282024-12-21T07:58:53.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123292024-12-21T07:58:53.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123302024-12-21T07:58:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.772875ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
123312024-12-21T07:58:53.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
123322024-12-21T07:58:53.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123332024-12-21T07:58:53.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123342024-12-21T07:58:53.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.655134ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123352024-12-21T07:58:53.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123362024-12-21T07:58:53.709ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123372024-12-21T07:58:53.709ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e40880-e721-4091-ac30-b53d732ede8e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123382024-12-21T07:58:53.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123392024-12-21T07:58:53.711ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123402024-12-21T07:58:53.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
123412024-12-21T07:58:53.720ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123422024-12-21T07:58:53.721ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93712477-1ca0-46ce-ae10-f484847f4fe9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123432024-12-21T07:58:53.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123442024-12-21T07:58:53.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
123452024-12-21T07:58:53.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123462024-12-21T07:58:53.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123472024-12-21T07:58:53.814ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 229.119689ms iteration = 27 status = {"physical_disks_added":0}
123482024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
123492024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123502024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 236.647688ms iteration = 24 status = 0
123512024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "90c47c14-89d7-4698-8c01-d4dac5512bec", "content-length": "130", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123522024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }, migration_in: None, migration_out: None } vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123532024-12-21T07:58:53.821ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }
123542024-12-21T07:58:53.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b roles = RoleSet { roles: {} } sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123552024-12-21T07:58:53.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b resource = Database result = Ok(()) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123562024-12-21T07:58:53.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123572024-12-21T07:58:53.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123582024-12-21T07:58:53.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123592024-12-21T07:58:53.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123602024-12-21T07:58:53.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
123612024-12-21T07:58:53.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3953f9b-ba55-4ba8-a69c-47191c5c227d", "content-length": "1", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123622024-12-21T07:58:53.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123632024-12-21T07:58:53.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123642024-12-21T07:58:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123652024-12-21T07:58:53.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123662024-12-21T07:58:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123672024-12-21T07:58:53.830ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.175615ms iteration = 24 status = null
123682024-12-21T07:58:53.838ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 252.856657ms iteration = 24 status = {}
123692024-12-21T07:58:53.847ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123702024-12-21T07:58:53.847ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123712024-12-21T07:58:53.847ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 262.800057ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123722024-12-21T07:58:53.854ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123732024-12-21T07:58:53.854ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123742024-12-21T07:58:53.855ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb19755-c87d-4108-8a91-83dc7fa1a986", "content-length": "583", "date": "Sat, 21 Dec 2024 07:58:52 GMT"} })
123752024-12-21T07:58:53.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123762024-12-21T07:58:53.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123772024-12-21T07:58:53.857ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
123782024-12-21T07:58:53.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 273.949048ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
123792024-12-21T07:58:53.906ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
123802024-12-21T07:58:53.906ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123812024-12-21T07:58:53.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123822024-12-21T07:58:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123832024-12-21T07:58:53.924ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
123842024-12-21T07:58:53.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123852024-12-21T07:58:53.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123862024-12-21T07:58:53.933ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123872024-12-21T07:58:53.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123882024-12-21T07:58:53.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f043c4e-a6dd-4dec-b5fe-9d3c835e0aac", "content-length": "134", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123892024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123902024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
123912024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123922024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123932024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123942024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123952024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123962024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123972024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123982024-12-21T07:58:53.944ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123992024-12-21T07:58:53.945ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
124002024-12-21T07:58:53.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124012024-12-21T07:58:53.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124022024-12-21T07:58:53.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124032024-12-21T07:58:53.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "103c9c28-374f-4399-b34d-8f5e5d22fffe", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124042024-12-21T07:58:53.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124052024-12-21T07:58:53.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c955aea6-fc36-4abf-83a0-881b992d485d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124062024-12-21T07:58:53.947ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
124072024-12-21T07:58:53.947ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124082024-12-21T07:58:53.994ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e88eab4e-6700-4041-8241-3798d322706f", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124092024-12-21T07:58:53.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124102024-12-21T07:58:53.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124112024-12-21T07:58:53.995ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "93d5d47c-134b-4ba7-b5b7-7d291653f028", "content-length": "810", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124122024-12-21T07:58:53.995ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(7358898) }} sled = buskin
124132024-12-21T07:58:53.995ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
124142024-12-21T07:58:53.995ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
124152024-12-21T07:58:53.997ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 412.455004ms iteration = 24 status = {}
124162024-12-21T07:58:53.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124172024-12-21T07:58:53.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124182024-12-21T07:58:54.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124192024-12-21T07:58:54.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124202024-12-21T07:58:54.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124212024-12-21T07:58:54.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124222024-12-21T07:58:54.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124232024-12-21T07:58:54.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124242024-12-21T07:58:54.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124252024-12-21T07:58:54.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124262024-12-21T07:58:54.015ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124272024-12-21T07:58:54.015ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124282024-12-21T07:58:54.015ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124292024-12-21T07:58:54.016ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1afed0ad-c7af-4ce4-95e5-41325a5c21ce", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124302024-12-21T07:58:54.017ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 432.348095ms iteration = 24 status = {}
124312024-12-21T07:58:54.185ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9117aaea-4710-410a-a4ce-b0aa0a63e945", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124322024-12-21T07:58:54.185ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
124332024-12-21T07:58:54.185ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124342024-12-21T07:58:54.186ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf324f6-1a61-42e9-81e0-9403c802cd62", "content-length": "682", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124352024-12-21T07:58:54.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124362024-12-21T07:58:54.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124372024-12-21T07:58:54.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124382024-12-21T07:58:54.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124392024-12-21T07:58:54.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124402024-12-21T07:58:54.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124412024-12-21T07:58:54.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124422024-12-21T07:58:54.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124432024-12-21T07:58:54.203ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 618.650981ms iteration = 24 status = {}
124442024-12-21T07:58:54.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3194e488-13ab-4e92-9133-9c2cb059b5bf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124452024-12-21T07:58:54.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3194e488-13ab-4e92-9133-9c2cb059b5bf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124462024-12-21T07:58:54.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3194e488-13ab-4e92-9133-9c2cb059b5bf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124472024-12-21T07:58:55.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb37e6-3868-4323-a71f-e0a22308402f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124482024-12-21T07:58:55.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb37e6-3868-4323-a71f-e0a22308402f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124492024-12-21T07:58:55.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 46bb37e6-3868-4323-a71f-e0a22308402f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124502024-12-21T07:58:55.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 3b5f4798-036f-4466-a0dd-535c3b1067d0 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
124512024-12-21T07:58:56.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ca156ac-63b4-4e6b-80ee-36e147ac195a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124522024-12-21T07:58:56.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ca156ac-63b4-4e6b-80ee-36e147ac195a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124532024-12-21T07:58:56.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4ca156ac-63b4-4e6b-80ee-36e147ac195a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124542024-12-21T07:58:57.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 032912b2-ba71-4a1e-8308-60dc17973c26 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124552024-12-21T07:58:57.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 032912b2-ba71-4a1e-8308-60dc17973c26 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124562024-12-21T07:58:57.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 032912b2-ba71-4a1e-8308-60dc17973c26 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124572024-12-21T07:58:58.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4542805e-87ea-48ba-a4dc-b228715feffb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124582024-12-21T07:58:58.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4542805e-87ea-48ba-a4dc-b228715feffb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124592024-12-21T07:58:58.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4542805e-87ea-48ba-a4dc-b228715feffb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124602024-12-21T07:58:59.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 444aef60-2f6b-42bc-b493-eca182cae5b9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124612024-12-21T07:58:59.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 444aef60-2f6b-42bc-b493-eca182cae5b9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124622024-12-21T07:58:59.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 444aef60-2f6b-42bc-b493-eca182cae5b9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124632024-12-21T07:59:00.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dd3e5438-e5ae-46ad-8365-2140e451c16b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124642024-12-21T07:59:00.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dd3e5438-e5ae-46ad-8365-2140e451c16b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124652024-12-21T07:59:00.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = dd3e5438-e5ae-46ad-8365-2140e451c16b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124662024-12-21T07:59:01.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5a37a1b-af75-490d-b8f2-cc6fb4fb5078 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124672024-12-21T07:59:01.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5a37a1b-af75-490d-b8f2-cc6fb4fb5078 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124682024-12-21T07:59:01.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = d5a37a1b-af75-490d-b8f2-cc6fb4fb5078 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124692024-12-21T07:59:02.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48d5ff18-0427-47c0-bb0d-b17e8fa80dc4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124702024-12-21T07:59:02.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48d5ff18-0427-47c0-bb0d-b17e8fa80dc4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124712024-12-21T07:59:02.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 48d5ff18-0427-47c0-bb0d-b17e8fa80dc4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124722024-12-21T07:59:03.333ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c2479c6-3bfe-415a-ace4-1d3fec7d674f uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:59:03.332894386Z }
124732024-12-21T07:59:03.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c2479c6-3bfe-415a-ace4-1d3fec7d674f roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
124742024-12-21T07:59:03.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c2479c6-3bfe-415a-ace4-1d3fec7d674f resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
124752024-12-21T07:59:03.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50766 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 1c2479c6-3bfe-415a-ace4-1d3fec7d674f response_code = 204 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
124762024-12-21T07:59:03.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
124772024-12-21T07:59:03.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124782024-12-21T07:59:03.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
124792024-12-21T07:59:03.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124802024-12-21T07:59:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124812024-12-21T07:59:03.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124822024-12-21T07:59:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124832024-12-21T07:59:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124842024-12-21T07:59:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124852024-12-21T07:59:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124862024-12-21T07:59:03.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124872024-12-21T07:59:03.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124882024-12-21T07:59:03.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124892024-12-21T07:59:03.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
124902024-12-21T07:59:03.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124912024-12-21T07:59:03.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124922024-12-21T07:59:03.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
124932024-12-21T07:59:03.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.651525ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
124942024-12-21T07:59:03.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124952024-12-21T07:59:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124962024-12-21T07:59:03.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.982081ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124972024-12-21T07:59:03.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420c3d09-1fcc-4310-bb3e-4aa7653c0b98 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124982024-12-21T07:59:03.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420c3d09-1fcc-4310-bb3e-4aa7653c0b98 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124992024-12-21T07:59:03.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 420c3d09-1fcc-4310-bb3e-4aa7653c0b98 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
125002024-12-21T07:59:04.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbbe363e-f007-4f9d-906c-ccbf12b91b8a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
125012024-12-21T07:59:04.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbbe363e-f007-4f9d-906c-ccbf12b91b8a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
125022024-12-21T07:59:04.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cbbe363e-f007-4f9d-906c-ccbf12b91b8a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
125032024-12-21T07:59:05.823ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:59:05.822725091Z }
125042024-12-21T07:59:05.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125052024-12-21T07:59:05.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125062024-12-21T07:59:05.831ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_needs_update = true
125072024-12-21T07:59:05.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125082024-12-21T07:59:05.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125092024-12-21T07:59:05.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125102024-12-21T07:59:05.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125112024-12-21T07:59:05.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125122024-12-21T07:59:05.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125132024-12-21T07:59:05.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125142024-12-21T07:59:05.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125152024-12-21T07:59:05.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125162024-12-21T07:59:05.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125172024-12-21T07:59:05.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125182024-12-21T07:59:05.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125192024-12-21T07:59:05.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125202024-12-21T07:59:05.849ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 27cf67c6-23b4-42ef-b405-5566b18d9353, lookup_type: ById(27cf67c6-23b4-42ef-b405-5566b18d9353) }, key: 6f7deba6-bca8-40a5-a059-99eca3610b4b, lookup_type: ById(6f7deba6-bca8-40a5-a059-99eca3610b4b) } result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125212024-12-21T07:59:05.855ZINFOnexus (dropshot_internal): starting update saga for 6f7deba6-bca8-40a5-a059-99eca3610b4b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:59:05.822725091Z }
125222024-12-21T07:59:05.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32952 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 response_code = 204 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125232024-12-21T07:59:05.855ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6f7deba6-bca8-40a5-a059-99eca3610b4b... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31536183-6e98-47e1-8521-34fd2b947a44 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125242024-12-21T07:59:05.855ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update
125252024-12-21T07:59:05.856ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 216411b9-771b-4e08-aa8f-833edaf4ff04 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:59:05.822725091Z }
125262024-12-21T07:59:05.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 216411b9-771b-4e08-aa8f-833edaf4ff04 roles = RoleSet { roles: {} } uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125272024-12-21T07:59:05.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 216411b9-771b-4e08-aa8f-833edaf4ff04 resource = Database result = Ok(()) uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125282024-12-21T07:59:05.862ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6f7deba6-bca8-40a5-a059-99eca3610b4b","lookup_type":{"ById":"6f7deba6-bca8-40a5-a059-99eca3610b4b"},"parent":{"key":"27cf67c6-23b4-42ef-b405-5566b18d9353","lookup_type":{"ById":"27cf67c6-23b4-42ef-b405-5566b18d9353"},"parent":{"key":"fe5ecf26-3a15-476c-b566-aba979f13c53","lookup_type":{"ById":"fe5ecf26-3a15-476c-b566-aba979f13c53"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125292024-12-21T07:59:05.863ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update
125302024-12-21T07:59:05.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29539 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 216411b9-771b-4e08-aa8f-833edaf4ff04 response_code = 204 uri = /vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f
125312024-12-21T07:59:05.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 76e421c3-e7c9-4f95-bf40-0ca9488588cc response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
125322024-12-21T07:59:05.897ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update
125332024-12-21T07:59:05.897ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125342024-12-21T07:59:05.897ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125352024-12-21T07:59:05.897ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125362024-12-21T07:59:05.901ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125372024-12-21T07:59:05.901ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125382024-12-21T07:59:05.905ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125392024-12-21T07:59:05.905ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125402024-12-21T07:59:05.913ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125412024-12-21T07:59:05.913ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4ea4301a-c080-4827-bb30-b08a1e140617")) node_id = 0 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125422024-12-21T07:59:05.916ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125432024-12-21T07:59:05.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125442024-12-21T07:59:05.927ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update
125452024-12-21T07:59:05.929ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125462024-12-21T07:59:05.930ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125472024-12-21T07:59:05.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125482024-12-21T07:59:05.932ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125492024-12-21T07:59:05.934ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125502024-12-21T07:59:05.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125512024-12-21T07:59:05.936ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125522024-12-21T07:59:05.937ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125532024-12-21T07:59:05.938ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125542024-12-21T07:59:05.938ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125552024-12-21T07:59:05.939ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125562024-12-21T07:59:05.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125572024-12-21T07:59:05.941ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125582024-12-21T07:59:05.946ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 27cf67c6-23b4-42ef-b405-5566b18d9353, lookup_type: ById(27cf67c6-23b4-42ef-b405-5566b18d9353) }, key: 6f7deba6-bca8-40a5-a059-99eca3610b4b, lookup_type: ById(6f7deba6-bca8-40a5-a059-99eca3610b4b) } result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125592024-12-21T07:59:05.946ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance updater_id = 4ea4301a-c080-4827-bb30-b08a1e140617
125602024-12-21T07:59:05.946ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125612024-12-21T07:59:05.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125622024-12-21T07:59:05.970ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance updater_id = 4ea4301a-c080-4827-bb30-b08a1e140617
125632024-12-21T07:59:05.970ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125642024-12-21T07:59:05.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance
125652024-12-21T07:59:05.977ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b locked_gen = Generation(Generation(2)) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = LockInstance updater_id = 4ea4301a-c080-4827-bb30-b08a1e140617
125662024-12-21T07:59:05.977ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125672024-12-21T07:59:05.977ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4ea4301a-c080-4827-bb30-b08a1e140617")}) node_id = 1 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125682024-12-21T07:59:05.982ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125692024-12-21T07:59:05.982ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
125702024-12-21T07:59:05.990ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125712024-12-21T07:59:05.990ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125722024-12-21T07:59:05.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125732024-12-21T07:59:05.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125742024-12-21T07:59:05.993ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125752024-12-21T07:59:05.993ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125762024-12-21T07:59:05.995ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125772024-12-21T07:59:05.998ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 27cf67c6-23b4-42ef-b405-5566b18d9353, lookup_type: ById(27cf67c6-23b4-42ef-b405-5566b18d9353) }, key: 6f7deba6-bca8-40a5-a059-99eca3610b4b, lookup_type: ById(6f7deba6-bca8-40a5-a059-99eca3610b4b) } result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125782024-12-21T07:59:05.998ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125792024-12-21T07:59:05.998ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125802024-12-21T07:59:06.004ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 035b4828-aaf9-4ffa-b53c-96c2c815880f, time_created: 2024-12-21T07:58:45.119354Z, time_deleted: None, instance_id: 6f7deba6-bca8-40a5-a059-99eca3610b4b, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-21T07:59:05.822725Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T07:58:42.830560Z, gen: Generation(Generation(3)), propolis_id: Some(035b4828-aaf9-4ffa-b53c-96c2c815880f), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(035b4828-aaf9-4ffa-b53c-96c2c815880f (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T07:59:06.004596231Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
125812024-12-21T07:59:06.006ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
125822024-12-21T07:59:06.009ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6f7deba6-bca8-40a5-a059-99eca3610b4b","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"035b4828-aaf9-4ffa-b53c-96c2c815880f"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6f7deba6-bca8-40a5-a059-99eca3610b4b","lookup_type":{"ById":"6f7deba6-bca8-40a5-a059-99eca3610b4b"},"parent":{"key":"27cf67c6-23b4-42ef-b405-5566b18d9353","lookup_type":{"ById":"27cf67c6-23b4-42ef-b405-5566b18d9353"},"parent":{"key":"fe5ecf26-3a15-476c-b566-aba979f13c53","lookup_type":{"ById":"fe5ecf26-3a15-476c-b566-aba979f13c53"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"4ea4301a-c080-4827-bb30-b08a1e140617"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"27cf67c6-23b4-42ef-b405-5566b18d9353","ram_diff":1073741824},"destroy_active_vmm":"035b4828-aaf9-4ffa-b53c-96c2c815880f","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-21T07:59:06.004596231Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125832024-12-21T07:59:06.009ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
125842024-12-21T07:59:06.014ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
125852024-12-21T07:59:06.014ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125862024-12-21T07:59:06.014ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125872024-12-21T07:59:06.014ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
125882024-12-21T07:59:06.017ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125892024-12-21T07:59:06.017ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
125902024-12-21T07:59:06.020ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125912024-12-21T07:59:06.020ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
125922024-12-21T07:59:06.024ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125932024-12-21T07:59:06.024ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8")) node_id = 0 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
125942024-12-21T07:59:06.027ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
125952024-12-21T07:59:06.027ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
125962024-12-21T07:59:06.037ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b parent_lock = UpdaterLock { updater_id: 4ea4301a-c080-4827-bb30-b08a1e140617, locked_gen: Generation(Generation(2)) } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
125972024-12-21T07:59:06.037ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = BecomeUpdater
125982024-12-21T07:59:06.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = BecomeUpdater
125992024-12-21T07:59:06.048ZDEBGnexus (SagaExecutor): inherited lock from 4ea4301a-c080-4827-bb30-b08a1e140617 to c8c5221e-4e19-4b38-8379-ca74e7d6eea8 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 4ea4301a-c080-4827-bb30-b08a1e140617 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = BecomeUpdater updater_id = c8c5221e-4e19-4b38-8379-ca74e7d6eea8
126002024-12-21T07:59:06.050ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126012024-12-21T07:59:06.050ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126022024-12-21T07:59:06.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8")}) node_id = 1 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126032024-12-21T07:59:06.054ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126042024-12-21T07:59:06.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126052024-12-21T07:59:06.057ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126062024-12-21T07:59:06.057ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126072024-12-21T07:59:06.060ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126082024-12-21T07:59:06.060ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126092024-12-21T07:59:06.063ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126102024-12-21T07:59:06.063ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b
126112024-12-21T07:59:06.065ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126122024-12-21T07:59:06.066ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126132024-12-21T07:59:06.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126142024-12-21T07:59:06.069ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126152024-12-21T07:59:06.075ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
126162024-12-21T07:59:06.075ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126172024-12-21T07:59:06.075ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UpdateNetworkConfig
126182024-12-21T07:59:06.077ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
126192024-12-21T07:59:06.077ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
126202024-12-21T07:59:06.077ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
126212024-12-21T07:59:06.079ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
126222024-12-21T07:59:06.080ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
126232024-12-21T07:59:06.080ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
126242024-12-21T07:59:06.080ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
126252024-12-21T07:59:06.088ZDEBGnexus: notifying dendrite of updates instance_id = Some(6f7deba6-bca8-40a5-a059-99eca3610b4b (instance)) switch = switch0
126262024-12-21T07:59:06.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1666, tv_nsec: 35379356 } })
126272024-12-21T07:59:06.089ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
126282024-12-21T07:59:06.119ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
126292024-12-21T07:59:06.119ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126302024-12-21T07:59:06.120ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1e56d19-9708-45b4-b480-e9f2c5046533", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:05 GMT"} })
126312024-12-21T07:59:06.120ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126322024-12-21T07:59:06.120ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126332024-12-21T07:59:06.150ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
126342024-12-21T07:59:06.150ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "617a6efa-7748-4eed-b9f8-ba94b8f85a66", "content-length": "4", "date": "Sat, 21 Dec 2024 07:59:05 GMT"} })
126352024-12-21T07:59:06.151ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126362024-12-21T07:59:06.151ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126372024-12-21T07:59:06.155ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126382024-12-21T07:59:06.155ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126392024-12-21T07:59:06.158ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
126402024-12-21T07:59:06.159ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
126412024-12-21T07:59:06.171ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-21T07:59:06.161874Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 27cf67c6-23b4-42ef-b405-5566b18d9353, time_modified: Some(2024-12-21T07:59:06.161874Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: fe5ecf26-3a15-476c-b566-aba979f13c53, time_modified: Some(2024-12-21T07:59:06.161874Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126422024-12-21T07:59:06.171ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126432024-12-21T07:59:06.171ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126442024-12-21T07:59:06.175ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126452024-12-21T07:59:06.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126462024-12-21T07:59:06.180ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126472024-12-21T07:59:06.180ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UnassignOximeterProducer
126482024-12-21T07:59:06.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UnassignOximeterProducer
126492024-12-21T07:59:06.185ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e producer_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126502024-12-21T07:59:06.185ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UnassignOximeterProducer
126512024-12-21T07:59:06.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = UnassignOximeterProducer
126522024-12-21T07:59:06.220ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126532024-12-21T07:59:06.222ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6f7deba6-bca8-40a5-a059-99eca3610b4b
126542024-12-21T07:59:06.246ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6f7deba6-bca8-40a5-a059-99eca3610b4b result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6f7deba6-bca8-40a5-a059-99eca3610b4b", status: 204, headers: {"x-request-id": "f2d2620d-2779-4270-8590-82cdeae4fa9f", "date": "Sat, 21 Dec 2024 07:59:06 GMT"} }) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126552024-12-21T07:59:06.246ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e producer_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126562024-12-21T07:59:06.248ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126572024-12-21T07:59:06.248ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126582024-12-21T07:59:06.251ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126592024-12-21T07:59:06.251ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126602024-12-21T07:59:06.254ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b lock = UpdaterLock { updater_id: c8c5221e-4e19-4b38-8379-ca74e7d6eea8, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T07:59:06.004596231Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126612024-12-21T07:59:06.254ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = CommitInstanceUpdates
126622024-12-21T07:59:06.255ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = CommitInstanceUpdates
126632024-12-21T07:59:06.353ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T07:59:06.004596231Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126642024-12-21T07:59:06.353ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126652024-12-21T07:59:06.353ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126662024-12-21T07:59:06.353ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
126672024-12-21T07:59:06.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126682024-12-21T07:59:06.353ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
126692024-12-21T07:59:06.353ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126702024-12-21T07:59:06.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126712024-12-21T07:59:06.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126722024-12-21T07:59:06.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126732024-12-21T07:59:06.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126742024-12-21T07:59:06.356ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126752024-12-21T07:59:06.356ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126762024-12-21T07:59:06.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126772024-12-21T07:59:06.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126782024-12-21T07:59:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126792024-12-21T07:59:06.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126802024-12-21T07:59:06.359ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126812024-12-21T07:59:06.359ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6f7deba6-bca8-40a5-a059-99eca3610b4b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("035b4828-aaf9-4ffa-b53c-96c2c815880f")}) node_id = 7 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126822024-12-21T07:59:06.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126832024-12-21T07:59:06.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126842024-12-21T07:59:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126852024-12-21T07:59:06.362ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126862024-12-21T07:59:06.362ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126872024-12-21T07:59:06.366ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126882024-12-21T07:59:06.366ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126892024-12-21T07:59:06.371ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126902024-12-21T07:59:06.371ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126912024-12-21T07:59:06.374ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126922024-12-21T07:59:06.374ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ReleaseSledResources
126932024-12-21T07:59:06.374ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ReleaseSledResources
126942024-12-21T07:59:06.384ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126952024-12-21T07:59:06.384ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126962024-12-21T07:59:06.388ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
126972024-12-21T07:59:06.388ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
126982024-12-21T07:59:06.392ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
126992024-12-21T07:59:06.392ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = MarkVmmDeleted
127002024-12-21T07:59:06.392ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = MarkVmmDeleted
127012024-12-21T07:59:06.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127022024-12-21T07:59:06.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127032024-12-21T07:59:06.404ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127042024-12-21T07:59:06.404ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127052024-12-21T07:59:06.407ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127062024-12-21T07:59:06.407ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127072024-12-21T07:59:06.411ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127082024-12-21T07:59:06.411ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127092024-12-21T07:59:06.414ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127102024-12-21T07:59:06.414ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127112024-12-21T07:59:06.418ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127122024-12-21T07:59:06.418ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127132024-12-21T07:59:06.449ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
127142024-12-21T07:59:06.449ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127152024-12-21T07:59:06.450ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d135ab1e-54fb-4a53-a39b-8c88606880b9", "content-length": "372", "date": "Sat, 21 Dec 2024 07:59:05 GMT"} })
127162024-12-21T07:59:06.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127172024-12-21T07:59:06.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127182024-12-21T07:59:06.453ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127192024-12-21T07:59:06.453ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127202024-12-21T07:59:06.455ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127212024-12-21T07:59:06.455ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127222024-12-21T07:59:06.457ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127232024-12-21T07:59:06.460ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 27cf67c6-23b4-42ef-b405-5566b18d9353, lookup_type: ById(27cf67c6-23b4-42ef-b405-5566b18d9353) }, key: 6f7deba6-bca8-40a5-a059-99eca3610b4b, lookup_type: ById(6f7deba6-bca8-40a5-a059-99eca3610b4b) } result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127242024-12-21T07:59:06.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127252024-12-21T07:59:06.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_node = ChainSuccessorSaga
127262024-12-21T07:59:06.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127272024-12-21T07:59:06.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127282024-12-21T07:59:06.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127292024-12-21T07:59:06.463ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b karmic_state = WillReincarnate needs_reincarnation = false saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update
127302024-12-21T07:59:06.463ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127312024-12-21T07:59:06.463ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127322024-12-21T07:59:06.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127332024-12-21T07:59:06.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127342024-12-21T07:59:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127352024-12-21T07:59:06.466ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127362024-12-21T07:59:06.466ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127372024-12-21T07:59:06.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127382024-12-21T07:59:06.471ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127392024-12-21T07:59:06.471ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127402024-12-21T07:59:06.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127412024-12-21T07:59:06.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127422024-12-21T07:59:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127432024-12-21T07:59:06.474ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127442024-12-21T07:59:06.474ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5
127452024-12-21T07:59:06.501ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
127462024-12-21T07:59:06.501ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
127472024-12-21T07:59:06.501ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c9e13ac3-bc9b-488e-b49b-3d77cb1ceef2", "date": "Sat, 21 Dec 2024 07:59:06 GMT"} })
127482024-12-21T07:59:06.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127492024-12-21T07:59:06.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127502024-12-21T07:59:06.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127512024-12-21T07:59:06.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127522024-12-21T07:59:06.505ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
127532024-12-21T07:59:06.505ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ad69bec-b95c-4d75-87bf-9e4a1f9b82c6", "content-length": "691", "date": "Sat, 21 Dec 2024 07:59:05 GMT"} })
127542024-12-21T07:59:06.505ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
127552024-12-21T07:59:06.505ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
127562024-12-21T07:59:06.505ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
127572024-12-21T07:59:06.506ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 152.821591ms iteration = 25 status = {}
127582024-12-21T07:59:06.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127592024-12-21T07:59:06.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127602024-12-21T07:59:06.510ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
127612024-12-21T07:59:06.510ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127622024-12-21T07:59:06.510ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "61dc24a3-a6ec-45f9-93ac-ce9ca63bb27a", "date": "Sat, 21 Dec 2024 07:59:05 GMT"} })
127632024-12-21T07:59:06.511ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 158.00741ms iteration = 25 status = {}
127642024-12-21T07:59:06.517ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127652024-12-21T07:59:06.517ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 saga_name = instance-update saga_result = SagaResult { saga_id: 2106881b-1774-47ec-b1fa-c2a40ddb58f5, saga_log: SagaLog { saga_id: 2106881b-1774-47ec-b1fa-c2a40ddb58f5, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6f7deba6-bca8-40a5-a059-99eca3610b4b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("035b4828-aaf9-4ffa-b53c-96c2c815880f")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6f7deba6-bca8-40a5-a059-99eca3610b4b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("035b4828-aaf9-4ffa-b53c-96c2c815880f")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c8c5221e-4e19-4b38-8379-ca74e7d6eea8")}} }) }
127662024-12-21T07:59:06.517ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 2106881b-1774-47ec-b1fa-c2a40ddb58f5 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update
127672024-12-21T07:59:06.517ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127682024-12-21T07:59:06.517ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
127692024-12-21T07:59:06.521ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127702024-12-21T07:59:06.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
127712024-12-21T07:59:06.523ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127722024-12-21T07:59:06.523ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
127732024-12-21T07:59:06.526ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127742024-12-21T07:59:06.526ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796
127752024-12-21T07:59:06.567ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update sec_id = 4b205886-0970-4a9e-bff0-ae1192504434
127762024-12-21T07:59:06.567ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cb82be84-be49-4f39-be8c-95e2c9bbf796 saga_name = start-instance-update saga_result = SagaResult { saga_id: cb82be84-be49-4f39-be8c-95e2c9bbf796, saga_log: SagaLog { saga_id: cb82be84-be49-4f39-be8c-95e2c9bbf796, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("4ea4301a-c080-4827-bb30-b08a1e140617")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4ea4301a-c080-4827-bb30-b08a1e140617")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("4ea4301a-c080-4827-bb30-b08a1e140617"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("4ea4301a-c080-4827-bb30-b08a1e140617")}} }) }
127772024-12-21T07:59:06.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edf5c7b2-78f5-4be0-9c08-abed489d8f2d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127782024-12-21T07:59:06.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edf5c7b2-78f5-4be0-9c08-abed489d8f2d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127792024-12-21T07:59:06.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = edf5c7b2-78f5-4be0-9c08-abed489d8f2d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127802024-12-21T07:59:07.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 111005d7-2fa5-4cef-81cb-1f25cacce03d roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127812024-12-21T07:59:07.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 111005d7-2fa5-4cef-81cb-1f25cacce03d resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127822024-12-21T07:59:07.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 111005d7-2fa5-4cef-81cb-1f25cacce03d response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127832024-12-21T07:59:08.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21a4f76e-b2c0-4474-9b93-fc9e80e01dfc roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127842024-12-21T07:59:08.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21a4f76e-b2c0-4474-9b93-fc9e80e01dfc resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127852024-12-21T07:59:08.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 21a4f76e-b2c0-4474-9b93-fc9e80e01dfc response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127862024-12-21T07:59:09.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = caf607a7-823c-49d4-a362-5f24cd4e99db roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127872024-12-21T07:59:09.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = caf607a7-823c-49d4-a362-5f24cd4e99db resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127882024-12-21T07:59:09.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = caf607a7-823c-49d4-a362-5f24cd4e99db response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127892024-12-21T07:59:10.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0c49b80-8b89-4c2e-bf27-b24a379d42cd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127902024-12-21T07:59:10.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0c49b80-8b89-4c2e-bf27-b24a379d42cd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127912024-12-21T07:59:10.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e0c49b80-8b89-4c2e-bf27-b24a379d42cd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127922024-12-21T07:59:11.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6d5be8b-943d-4041-86e5-98f4e5e8ea1f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127932024-12-21T07:59:11.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6d5be8b-943d-4041-86e5-98f4e5e8ea1f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127942024-12-21T07:59:11.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = b6d5be8b-943d-4041-86e5-98f4e5e8ea1f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127952024-12-21T07:59:12.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36a66229-546b-49ee-9868-16529bbfb3ce roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127962024-12-21T07:59:12.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36a66229-546b-49ee-9868-16529bbfb3ce resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127972024-12-21T07:59:12.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 36a66229-546b-49ee-9868-16529bbfb3ce response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
127982024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
127992024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
128002024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128012024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128022024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128032024-12-21T07:59:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128042024-12-21T07:59:13.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128052024-12-21T07:59:13.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128062024-12-21T07:59:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128072024-12-21T07:59:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128082024-12-21T07:59:13.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128092024-12-21T07:59:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128102024-12-21T07:59:13.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128112024-12-21T07:59:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128122024-12-21T07:59:13.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128132024-12-21T07:59:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
128142024-12-21T07:59:13.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128152024-12-21T07:59:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128162024-12-21T07:59:13.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
128172024-12-21T07:59:13.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.671932ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
128182024-12-21T07:59:13.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.623272ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128192024-12-21T07:59:14.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 303f89e5-0340-40bc-8578-38ae206babad roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128202024-12-21T07:59:14.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 303f89e5-0340-40bc-8578-38ae206babad resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128212024-12-21T07:59:14.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 303f89e5-0340-40bc-8578-38ae206babad response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128222024-12-21T07:59:15.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d9f574c-b873-410e-a7ac-3b2c3918e3e4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128232024-12-21T07:59:15.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d9f574c-b873-410e-a7ac-3b2c3918e3e4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128242024-12-21T07:59:15.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 8d9f574c-b873-410e-a7ac-3b2c3918e3e4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128252024-12-21T07:59:15.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 791 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 87af0eb0-3ca9-4c25-850a-5c5c00d3480c response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
128262024-12-21T07:59:16.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14a427eb-acb5-4570-9af1-c0dd6775dae4 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128272024-12-21T07:59:16.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14a427eb-acb5-4570-9af1-c0dd6775dae4 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128282024-12-21T07:59:16.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 14a427eb-acb5-4570-9af1-c0dd6775dae4 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128292024-12-21T07:59:17.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ffe4016-5313-4175-bcdf-9d7f9b4e6789 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128302024-12-21T07:59:17.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ffe4016-5313-4175-bcdf-9d7f9b4e6789 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128312024-12-21T07:59:17.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0ffe4016-5313-4175-bcdf-9d7f9b4e6789 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128322024-12-21T07:59:18.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31d40a48-418b-4d91-bb2c-73d49f1fd27c roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128332024-12-21T07:59:18.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31d40a48-418b-4d91-bb2c-73d49f1fd27c resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128342024-12-21T07:59:18.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 31d40a48-418b-4d91-bb2c-73d49f1fd27c response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128352024-12-21T07:59:19.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 599bac0c-fb81-4b1e-8ccb-72a60f76bb39 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128362024-12-21T07:59:19.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 599bac0c-fb81-4b1e-8ccb-72a60f76bb39 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128372024-12-21T07:59:19.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 599bac0c-fb81-4b1e-8ccb-72a60f76bb39 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128382024-12-21T07:59:20.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce9be4a4-a079-4111-a0bf-f9a48355f73f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128392024-12-21T07:59:20.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce9be4a4-a079-4111-a0bf-f9a48355f73f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128402024-12-21T07:59:20.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = ce9be4a4-a079-4111-a0bf-f9a48355f73f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128412024-12-21T07:59:21.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 938e13f8-1024-4234-9955-d41a4a0809b1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128422024-12-21T07:59:21.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 938e13f8-1024-4234-9955-d41a4a0809b1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128432024-12-21T07:59:21.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 938e13f8-1024-4234-9955-d41a4a0809b1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128442024-12-21T07:59:22.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2887ac3b-cbc9-40a0-bf88-8d0ce9134199 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128452024-12-21T07:59:22.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2887ac3b-cbc9-40a0-bf88-8d0ce9134199 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128462024-12-21T07:59:22.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2887ac3b-cbc9-40a0-bf88-8d0ce9134199 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128472024-12-21T07:59:23.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2704d6c8-ddd6-439f-9e8e-a2afd6ce0e11 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128482024-12-21T07:59:23.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2704d6c8-ddd6-439f-9e8e-a2afd6ce0e11 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128492024-12-21T07:59:23.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 2704d6c8-ddd6-439f-9e8e-a2afd6ce0e11 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
128502024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
128512024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128522024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
128532024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128542024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
128552024-12-21T07:59:23.585ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
128562024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128572024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128582024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
128592024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
128602024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
128612024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
128622024-12-21T07:59:23.585ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
128632024-12-21T07:59:23.585ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:49:23.585176940 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
128642024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
128652024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.72\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
128662024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
128672024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
128682024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
128692024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128702024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128712024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
128722024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128732024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
128742024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
128752024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
128762024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128772024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
128782024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
128792024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128802024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128812024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
128822024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
128832024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128842024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128852024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
128862024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128872024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
128882024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128892024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
128902024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
128912024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
128922024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128932024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
128942024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
128952024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
128962024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128972024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128982024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
128992024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129002024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
129012024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
129022024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
129032024-12-21T07:59:23.585ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
129042024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129052024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
129062024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
129072024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129082024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
129092024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
129102024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129112024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
129122024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
129132024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
129142024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129152024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129162024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129172024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129182024-12-21T07:59:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
129192024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129202024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129212024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129222024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129232024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129242024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
129252024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
129262024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
129272024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129282024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
129292024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129302024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129312024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129322024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129332024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
129342024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129352024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129362024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129372024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
129382024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129392024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129402024-12-21T07:59:23.586ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 532119860 } })
129412024-12-21T07:59:23.586ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 532130220 } })
129422024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129432024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129442024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129452024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129462024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129472024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129482024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
129492024-12-21T07:59:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.73396ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
129502024-12-21T07:59:23.587ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
129512024-12-21T07:59:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.888882ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
129522024-12-21T07:59:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129532024-12-21T07:59:23.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129542024-12-21T07:59:23.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129552024-12-21T07:59:23.591ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:49:23.585176940 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
129562024-12-21T07:59:23.591ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.769086ms iteration = 13 status = {"expiration":"2024-12-21T07:49:23.585176940Z","pruned":[]}
129572024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
129582024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129592024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129602024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129612024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129622024-12-21T07:59:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.051962ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
129632024-12-21T07:59:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129642024-12-21T07:59:23.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129652024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129662024-12-21T07:59:23.600ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129672024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.493766ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129682024-12-21T07:59:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129692024-12-21T07:59:23.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129702024-12-21T07:59:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129712024-12-21T07:59:23.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129722024-12-21T07:59:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129732024-12-21T07:59:23.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129742024-12-21T07:59:23.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 554579586 } })
129752024-12-21T07:59:23.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
129762024-12-21T07:59:23.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129772024-12-21T07:59:23.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129782024-12-21T07:59:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129792024-12-21T07:59:23.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129802024-12-21T07:59:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129812024-12-21T07:59:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129822024-12-21T07:59:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.85563ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
129832024-12-21T07:59:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129842024-12-21T07:59:23.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129852024-12-21T07:59:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129862024-12-21T07:59:23.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 563824544 } })
129872024-12-21T07:59:23.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
129882024-12-21T07:59:23.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129892024-12-21T07:59:23.660ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129902024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
129912024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129922024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129932024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129942024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129952024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129962024-12-21T07:59:23.665ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129972024-12-21T07:59:23.665ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129982024-12-21T07:59:23.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129992024-12-21T07:59:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130002024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.215826ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
130012024-12-21T07:59:23.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130022024-12-21T07:59:23.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130032024-12-21T07:59:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130042024-12-21T07:59:23.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130052024-12-21T07:59:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130062024-12-21T07:59:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130072024-12-21T07:59:23.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130082024-12-21T07:59:23.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130092024-12-21T07:59:23.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 628867360 } })
130102024-12-21T07:59:23.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
130112024-12-21T07:59:23.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
130122024-12-21T07:59:23.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130132024-12-21T07:59:23.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130142024-12-21T07:59:23.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130152024-12-21T07:59:23.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130162024-12-21T07:59:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130172024-12-21T07:59:23.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130182024-12-21T07:59:23.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130192024-12-21T07:59:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130202024-12-21T07:59:23.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
130212024-12-21T07:59:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130222024-12-21T07:59:23.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130232024-12-21T07:59:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130242024-12-21T07:59:23.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
130252024-12-21T07:59:23.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130262024-12-21T07:59:23.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130272024-12-21T07:59:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130282024-12-21T07:59:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130292024-12-21T07:59:23.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130302024-12-21T07:59:23.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130312024-12-21T07:59:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
130322024-12-21T07:59:23.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130332024-12-21T07:59:23.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130342024-12-21T07:59:23.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130352024-12-21T07:59:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
130362024-12-21T07:59:23.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130372024-12-21T07:59:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130382024-12-21T07:59:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
130392024-12-21T07:59:23.701ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130402024-12-21T07:59:23.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130412024-12-21T07:59:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130422024-12-21T07:59:23.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130432024-12-21T07:59:23.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130442024-12-21T07:59:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130452024-12-21T07:59:23.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130462024-12-21T07:59:23.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130472024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130482024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130492024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
130502024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130512024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130522024-12-21T07:59:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130532024-12-21T07:59:23.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130542024-12-21T07:59:23.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130552024-12-21T07:59:23.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130562024-12-21T07:59:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130572024-12-21T07:59:23.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130582024-12-21T07:59:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130592024-12-21T07:59:23.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 138.351054ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
130602024-12-21T07:59:23.724ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 139.508143ms iteration = 6 status = {"nsuccess":5}
130612024-12-21T07:59:23.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.923074ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130622024-12-21T07:59:23.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130632024-12-21T07:59:23.731ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130642024-12-21T07:59:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.653795ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
130652024-12-21T07:59:23.732ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
130662024-12-21T07:59:23.732ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
130672024-12-21T07:59:23.732ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.287306ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
130682024-12-21T07:59:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130692024-12-21T07:59:23.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
130702024-12-21T07:59:23.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 160.663735ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
130712024-12-21T07:59:23.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130722024-12-21T07:59:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130732024-12-21T07:59:23.752ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130742024-12-21T07:59:23.752ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130752024-12-21T07:59:23.752ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.2784ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130762024-12-21T07:59:23.756ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
130772024-12-21T07:59:23.756ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
130782024-12-21T07:59:23.757ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
130792024-12-21T07:59:23.757ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
130802024-12-21T07:59:23.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130812024-12-21T07:59:23.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130822024-12-21T07:59:23.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130832024-12-21T07:59:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 175.732664ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130842024-12-21T07:59:23.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130852024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 177.78893ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130862024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130872024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130882024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130892024-12-21T07:59:23.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130902024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130912024-12-21T07:59:23.763ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130922024-12-21T07:59:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130932024-12-21T07:59:23.763ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcae77be-ca4b-49ec-899d-a93e426d9d2f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
130942024-12-21T07:59:23.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130952024-12-21T07:59:23.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130962024-12-21T07:59:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130972024-12-21T07:59:23.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130982024-12-21T07:59:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130992024-12-21T07:59:23.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131002024-12-21T07:59:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131012024-12-21T07:59:23.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131022024-12-21T07:59:23.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131032024-12-21T07:59:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
131042024-12-21T07:59:23.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131052024-12-21T07:59:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131062024-12-21T07:59:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
131072024-12-21T07:59:23.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131082024-12-21T07:59:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131092024-12-21T07:59:23.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131102024-12-21T07:59:23.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131112024-12-21T07:59:23.785ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.022371ms iteration = 25 status = 0
131122024-12-21T07:59:23.795ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
131132024-12-21T07:59:23.795ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
131142024-12-21T07:59:23.795ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
131152024-12-21T07:59:23.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131162024-12-21T07:59:23.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131172024-12-21T07:59:23.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 211.09667ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
131182024-12-21T07:59:23.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131192024-12-21T07:59:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131202024-12-21T07:59:23.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131212024-12-21T07:59:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131222024-12-21T07:59:23.804ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
131232024-12-21T07:59:23.804ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
131242024-12-21T07:59:23.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131252024-12-21T07:59:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131262024-12-21T07:59:23.806ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
131272024-12-21T07:59:23.806ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
131282024-12-21T07:59:23.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131292024-12-21T07:59:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131302024-12-21T07:59:23.811ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 225.509978ms iteration = 28 status = {"physical_disks_added":0}
131312024-12-21T07:59:23.817ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
131322024-12-21T07:59:23.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131332024-12-21T07:59:23.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131342024-12-21T07:59:23.845ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
131352024-12-21T07:59:23.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 260.110181ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
131362024-12-21T07:59:23.850ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
131372024-12-21T07:59:23.850ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131382024-12-21T07:59:23.850ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a113543f-f2b7-4433-86f0-44d5aa769bd0", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
131392024-12-21T07:59:23.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131402024-12-21T07:59:23.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
131412024-12-21T07:59:23.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
131422024-12-21T07:59:23.892ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131432024-12-21T07:59:23.892ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b41c18-6038-494d-be49-7fbb88e09db2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
131442024-12-21T07:59:23.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131452024-12-21T07:59:23.893ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131462024-12-21T07:59:23.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131472024-12-21T07:59:23.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131482024-12-21T07:59:23.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
131492024-12-21T07:59:23.938ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131502024-12-21T07:59:23.938ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37ea2c9d-b50a-4825-9e53-e5170ae174c1", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:22 GMT"} })
131512024-12-21T07:59:23.939ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131522024-12-21T07:59:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131532024-12-21T07:59:23.961ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
131542024-12-21T07:59:23.961ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131552024-12-21T07:59:23.962ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c8fc1f7-7132-4898-b50b-cc57c2f24c14", "content-length": "372", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
131562024-12-21T07:59:23.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131572024-12-21T07:59:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131582024-12-21T07:59:23.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131592024-12-21T07:59:23.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131602024-12-21T07:59:23.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131612024-12-21T07:59:23.966ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 380.775971ms iteration = 25 status = null
131622024-12-21T07:59:23.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131632024-12-21T07:59:23.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131642024-12-21T07:59:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131652024-12-21T07:59:23.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
131662024-12-21T07:59:23.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131672024-12-21T07:59:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131682024-12-21T07:59:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131692024-12-21T07:59:23.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131702024-12-21T07:59:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131712024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
131722024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
131732024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
131742024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 387.073729ms iteration = 13 status = {"generation":2}
131752024-12-21T07:59:23.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131762024-12-21T07:59:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131772024-12-21T07:59:23.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131782024-12-21T07:59:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131792024-12-21T07:59:23.998ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
131802024-12-21T07:59:23.998ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
131812024-12-21T07:59:23.998ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
131822024-12-21T07:59:23.998ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 413.106956ms iteration = 13 status = {"generation":1}
131832024-12-21T07:59:24.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
131842024-12-21T07:59:24.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131852024-12-21T07:59:24.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "366b18c5-4949-48e6-a671-a490ae530916", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
131862024-12-21T07:59:24.002ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
131872024-12-21T07:59:24.003ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
131882024-12-21T07:59:24.003ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 418.500718ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
131892024-12-21T07:59:24.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3b9c9da6-dffb-4b85-a8dc-ec8899f1f7f2", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
131902024-12-21T07:59:24.004ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
131912024-12-21T07:59:24.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131922024-12-21T07:59:24.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131932024-12-21T07:59:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131942024-12-21T07:59:24.005ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
131952024-12-21T07:59:24.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.287248ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
131962024-12-21T07:59:24.010ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131972024-12-21T07:59:24.010ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131982024-12-21T07:59:24.011ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "67f4cba8-6367-43e5-93d9-d4dc9e09bbbd", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
131992024-12-21T07:59:24.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132002024-12-21T07:59:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132012024-12-21T07:59:24.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132022024-12-21T07:59:24.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132032024-12-21T07:59:24.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132042024-12-21T07:59:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132052024-12-21T07:59:24.026ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132062024-12-21T07:59:24.026ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132072024-12-21T07:59:24.026ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "558a5e1e-2a86-415a-9895-a370c24f6d75", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
132082024-12-21T07:59:24.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.605842ms iteration = 26 status = {}
132092024-12-21T07:59:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 447.519506ms iteration = 25 status = {}
132102024-12-21T07:59:24.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
132112024-12-21T07:59:24.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5b8202c4-8f41-44fd-8bdd-1fc5e3879ba4", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132122024-12-21T07:59:24.040ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132132024-12-21T07:59:24.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "956d23f6-145f-42d6-897e-8d521f254d76", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132142024-12-21T07:59:24.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132152024-12-21T07:59:24.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "306f8b99-bf72-47b8-bfbf-78ae668c802f", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132162024-12-21T07:59:24.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132172024-12-21T07:59:24.045ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132182024-12-21T07:59:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.963239ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
132192024-12-21T07:59:24.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132202024-12-21T07:59:24.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132212024-12-21T07:59:24.110ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
132222024-12-21T07:59:24.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132232024-12-21T07:59:24.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132242024-12-21T07:59:24.118ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
132252024-12-21T07:59:24.119ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ea50e7-ed54-451f-8961-cb752cbf2690", "content-length": "691", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} })
132262024-12-21T07:59:24.119ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
132272024-12-21T07:59:24.119ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
132282024-12-21T07:59:24.119ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
132292024-12-21T07:59:24.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
132302024-12-21T07:59:24.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "340bc0f2-2c0c-4dbd-96b9-fb6b27a7cfec", "content-length": "134", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
132312024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
132322024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
132332024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
132342024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
132352024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132362024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132372024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132382024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132392024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132402024-12-21T07:59:24.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132412024-12-21T07:59:24.121ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
132422024-12-21T07:59:24.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132432024-12-21T07:59:24.121ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 536.152546ms iteration = 26 status = {}
132442024-12-21T07:59:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132452024-12-21T07:59:24.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
132462024-12-21T07:59:24.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce519200-4169-4791-804f-663467fb285d", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
132472024-12-21T07:59:24.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
132482024-12-21T07:59:24.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b5dcedc-83ce-475e-b75d-05067b3b1eb8", "content-length": "52", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
132492024-12-21T07:59:24.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
132502024-12-21T07:59:24.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
132512024-12-21T07:59:24.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ed1fbe5-6d9c-4478-8af3-60733ed903ff", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} })
132522024-12-21T07:59:24.219ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
132532024-12-21T07:59:24.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
132542024-12-21T07:59:24.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f349c2-4e21-4596-89df-decf9477b1fb", "content-length": "682", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
132552024-12-21T07:59:24.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132562024-12-21T07:59:24.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132572024-12-21T07:59:24.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132582024-12-21T07:59:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132592024-12-21T07:59:24.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132602024-12-21T07:59:24.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132612024-12-21T07:59:24.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132622024-12-21T07:59:24.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132632024-12-21T07:59:24.236ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.651137ms iteration = 25 status = {}
132642024-12-21T07:59:24.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c47b6b3-052d-47ce-adce-837c91298415 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132652024-12-21T07:59:24.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c47b6b3-052d-47ce-adce-837c91298415 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132662024-12-21T07:59:24.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9c47b6b3-052d-47ce-adce-837c91298415 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132672024-12-21T07:59:25.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 427d6fca-d8f4-4843-8a4d-ef446b2e08bb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132682024-12-21T07:59:25.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 427d6fca-d8f4-4843-8a4d-ef446b2e08bb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132692024-12-21T07:59:25.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 427d6fca-d8f4-4843-8a4d-ef446b2e08bb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132702024-12-21T07:59:25.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 71c540c6-d4ea-4995-9703-b03bc5da8a75 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
132712024-12-21T07:59:26.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98b8cbd3-a156-4ced-ba43-887b2591025a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132722024-12-21T07:59:26.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98b8cbd3-a156-4ced-ba43-887b2591025a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132732024-12-21T07:59:26.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 98b8cbd3-a156-4ced-ba43-887b2591025a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132742024-12-21T07:59:27.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0817979d-b1a2-426f-b6de-22633cfbc026 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132752024-12-21T07:59:27.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0817979d-b1a2-426f-b6de-22633cfbc026 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132762024-12-21T07:59:27.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 0817979d-b1a2-426f-b6de-22633cfbc026 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132772024-12-21T07:59:28.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4eb1ebb5-d72b-4308-ac54-483ea77872f1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132782024-12-21T07:59:28.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4eb1ebb5-d72b-4308-ac54-483ea77872f1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132792024-12-21T07:59:28.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 4eb1ebb5-d72b-4308-ac54-483ea77872f1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132802024-12-21T07:59:29.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8fde2c5-69f2-41c2-870b-b9a2e6d53941 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132812024-12-21T07:59:29.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8fde2c5-69f2-41c2-870b-b9a2e6d53941 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132822024-12-21T07:59:29.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = a8fde2c5-69f2-41c2-870b-b9a2e6d53941 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132832024-12-21T07:59:30.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7963dc8e-1339-4e43-a0bd-8c80d5baef0f roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132842024-12-21T07:59:30.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7963dc8e-1339-4e43-a0bd-8c80d5baef0f resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132852024-12-21T07:59:30.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 7963dc8e-1339-4e43-a0bd-8c80d5baef0f response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132862024-12-21T07:59:31.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 970d54f4-6681-4434-b1a7-c523e71f3ddd roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132872024-12-21T07:59:31.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 970d54f4-6681-4434-b1a7-c523e71f3ddd resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132882024-12-21T07:59:31.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 970d54f4-6681-4434-b1a7-c523e71f3ddd response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132892024-12-21T07:59:32.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04f96d10-0ea8-4d60-a538-4db8945e4ec8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132902024-12-21T07:59:32.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04f96d10-0ea8-4d60-a538-4db8945e4ec8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132912024-12-21T07:59:32.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 04f96d10-0ea8-4d60-a538-4db8945e4ec8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132922024-12-21T07:59:33.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35ca6c13-1895-4075-8ade-59eac0d699cf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132932024-12-21T07:59:33.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35ca6c13-1895-4075-8ade-59eac0d699cf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132942024-12-21T07:59:33.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 35ca6c13-1895-4075-8ade-59eac0d699cf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
132952024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
132962024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
132972024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132982024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132992024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133002024-12-21T07:59:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133012024-12-21T07:59:33.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133022024-12-21T07:59:33.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133032024-12-21T07:59:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133042024-12-21T07:59:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133052024-12-21T07:59:33.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133062024-12-21T07:59:33.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133072024-12-21T07:59:33.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133082024-12-21T07:59:33.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133092024-12-21T07:59:33.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133102024-12-21T07:59:33.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
133112024-12-21T07:59:33.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133122024-12-21T07:59:33.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133132024-12-21T07:59:33.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
133142024-12-21T07:59:33.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.689675ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
133152024-12-21T07:59:33.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.963314ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133162024-12-21T07:59:34.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cffff424-c295-40ba-a87c-d036911f6808 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133172024-12-21T07:59:34.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cffff424-c295-40ba-a87c-d036911f6808 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133182024-12-21T07:59:34.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cffff424-c295-40ba-a87c-d036911f6808 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133192024-12-21T07:59:35.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5251256-c672-41c9-8a37-4ab433d0a7d3 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133202024-12-21T07:59:35.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5251256-c672-41c9-8a37-4ab433d0a7d3 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133212024-12-21T07:59:35.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = c5251256-c672-41c9-8a37-4ab433d0a7d3 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133222024-12-21T07:59:35.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = a20e39cf-b71a-425d-a2f4-8d7897e2b6cf roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133232024-12-21T07:59:35.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = a20e39cf-b71a-425d-a2f4-8d7897e2b6cf resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133242024-12-21T07:59:35.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = a20e39cf-b71a-425d-a2f4-8d7897e2b6cf response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133252024-12-21T07:59:35.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 9dc18ca6-1c01-4e2a-b60f-49ba0da4a359 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
133262024-12-21T07:59:35.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 9dc18ca6-1c01-4e2a-b60f-49ba0da4a359 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
133272024-12-21T07:59:35.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34932 req_id = 9dc18ca6-1c01-4e2a-b60f-49ba0da4a359 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
133282024-12-21T07:59:35.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = 5709addf-d8c5-4fa1-811d-4fe4530aa711 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
133292024-12-21T07:59:36.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 287e0534-57b5-45aa-835f-c1043bdecf9a roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133302024-12-21T07:59:36.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 287e0534-57b5-45aa-835f-c1043bdecf9a resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133312024-12-21T07:59:36.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 287e0534-57b5-45aa-835f-c1043bdecf9a response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133322024-12-21T07:59:37.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d426783-b6a9-48f2-82b5-5d494c190f5b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133332024-12-21T07:59:37.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d426783-b6a9-48f2-82b5-5d494c190f5b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133342024-12-21T07:59:37.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 3d426783-b6a9-48f2-82b5-5d494c190f5b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133352024-12-21T07:59:38.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68c4836f-a30a-4402-b9a4-52bb5155caf9 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133362024-12-21T07:59:38.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68c4836f-a30a-4402-b9a4-52bb5155caf9 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133372024-12-21T07:59:38.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 68c4836f-a30a-4402-b9a4-52bb5155caf9 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133382024-12-21T07:59:39.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a6cb49b-a49f-4d54-8216-8728fbd82047 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133392024-12-21T07:59:39.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a6cb49b-a49f-4d54-8216-8728fbd82047 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133402024-12-21T07:59:39.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a6cb49b-a49f-4d54-8216-8728fbd82047 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133412024-12-21T07:59:40.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cefbf10b-951b-47a9-983b-7879d00d9f3b roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133422024-12-21T07:59:40.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cefbf10b-951b-47a9-983b-7879d00d9f3b resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133432024-12-21T07:59:40.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = cefbf10b-951b-47a9-983b-7879d00d9f3b response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133442024-12-21T07:59:41.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a0632da-640e-4acf-a668-c911fe0687ea roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133452024-12-21T07:59:41.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a0632da-640e-4acf-a668-c911fe0687ea resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133462024-12-21T07:59:41.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 6a0632da-640e-4acf-a668-c911fe0687ea response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133472024-12-21T07:59:42.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe865922-7523-4e67-ba23-99759aa28fd8 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133482024-12-21T07:59:42.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe865922-7523-4e67-ba23-99759aa28fd8 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133492024-12-21T07:59:42.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = fe865922-7523-4e67-ba23-99759aa28fd8 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133502024-12-21T07:59:43.584ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
133512024-12-21T07:59:43.584ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
133522024-12-21T07:59:43.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133532024-12-21T07:59:43.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133542024-12-21T07:59:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133552024-12-21T07:59:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133562024-12-21T07:59:43.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133572024-12-21T07:59:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133582024-12-21T07:59:43.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133592024-12-21T07:59:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133602024-12-21T07:59:43.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133612024-12-21T07:59:43.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133622024-12-21T07:59:43.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133632024-12-21T07:59:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
133642024-12-21T07:59:43.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133652024-12-21T07:59:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133662024-12-21T07:59:43.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
133672024-12-21T07:59:43.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.252581ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
133682024-12-21T07:59:43.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133692024-12-21T07:59:43.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133702024-12-21T07:59:43.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.30374ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133712024-12-21T07:59:43.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871a75a0-9ce7-4fc5-b4bd-b68303eb5a24 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133722024-12-21T07:59:43.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871a75a0-9ce7-4fc5-b4bd-b68303eb5a24 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133732024-12-21T07:59:43.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 871a75a0-9ce7-4fc5-b4bd-b68303eb5a24 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133742024-12-21T07:59:44.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e93530c7-4873-4671-a231-4f0315862adf roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133752024-12-21T07:59:44.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e93530c7-4873-4671-a231-4f0315862adf resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133762024-12-21T07:59:44.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = e93530c7-4873-4671-a231-4f0315862adf response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133772024-12-21T07:59:45.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 838dbf6e-97c8-4fba-9f8e-1908c4697295 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133782024-12-21T07:59:45.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 838dbf6e-97c8-4fba-9f8e-1908c4697295 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133792024-12-21T07:59:45.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 838dbf6e-97c8-4fba-9f8e-1908c4697295 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133802024-12-21T07:59:45.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 766 local_addr = [fd00:1122:3344:101::c]:37319 method = GET remote_addr = [fd00:1122:3344:101::d]:38212 req_id = d5b1a3d8-dac2-4940-a19d-2a3555718140 response_code = 200 uri = /4b205886-0970-4a9e-bff0-ae1192504434
133812024-12-21T07:59:46.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76ee6618-5f5a-4798-b6a5-daca94dfcced roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133822024-12-21T07:59:46.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76ee6618-5f5a-4798-b6a5-daca94dfcced resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133832024-12-21T07:59:46.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 76ee6618-5f5a-4798-b6a5-daca94dfcced response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133842024-12-21T07:59:47.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9fc09240-fb25-410a-868a-b2382f360106 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133852024-12-21T07:59:47.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9fc09240-fb25-410a-868a-b2382f360106 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
133862024-12-21T07:59:47.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58681 req_id = 9fc09240-fb25-410a-868a-b2382f360106 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e